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Ill 

Abstract 

In this paper the asymptotic behavior of the conditional least squares estimators of the 
offspring mean matrix for a 2-type critical positively regular Galton-Watson branching 
process with immigration is described. We also study this question for a natural estimator 
of the spectral radius of the offspring mean matrix, which we call criticality parameter. 

We discuss the subcritical case as well. 

1 Introduction 

Branching processes have a number of applications in biology, finance, economics, queueing 
theory etc., see e.g. Haccou, Jagers and Vatutin [7j. Many aspects of applications in epidemi¬ 
ology, genetics and cell kinetics were presented at the 2009 Badajoz Workshop on Branching 
Processes, see [25] . 

The estimation theory for single-type Galton-Watson branching processes with immigration 
has a long history, see the survey paper of Winnicki [28). The critical case is the most inter¬ 
esting and complicated one. There are two multi-type critical Galton-Watson processes with 
immigration for which statistical inference is available: the unstable integer-valued autoregres¬ 
sive models of order 2 (which can be considered as a special 2-type Galton-Watson branching 
process with immigration), see Barczy et al. [5] and the 2-type doubly symmetric process, see 
Ispany et al. pm- In the present paper the asymptotic behavior of the conditional least squares 
(CLS) estimator of the offspring means and criticality parameter for the general 2-type critical 
positively regular Galton-Watson process with immigration is described, see Theorem 13.11 It 
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turns out that in a degenerate case this estimator is not even weakly consistent. We also study 
the asymptotic behavior of a natural estimator of the spectral radius of the offspring mean 
matrix, which we call criticality parameter. We discuss the subcritical case as well, but the 
supercritical case still remains open. 

Let us recall the results for a single-type Galton-Watson branching process (X k ) keZ+ with 
immigration. Assuming that the immigration mean m £ is known, the CLS estimator of the 
offspring mean m% based on the observations Xi,..., X n has the form 

~(n) _ ELi X k _x{X k - m e ) 

- s-^n y 2 

l^k= i^fc-i 

on the set ELi X l- 4 > 0, see Klimko ans Nelson (I7|. Suppose that m e > 0, and the second 
moment of the branching and immigration distributions are finite. 


If the process is subcritical, i.e., m £ < 1, then the probability of the existence of the 
estimator m X tends to 1 as n —* oo, and the estimator m X> is strongly consistent, i.e., 
m^ 1 ) XXf m ^ as n —» oo. If, in addition, the third moments of the branching and immigration 
distributions are finite, then 


( 1 . 1 ) 


n 1 / 2 



m n) 



h e E(I 3 ) + k e E(I 2 )\ 
[E(X 2 )] 2 ) 


as n —» oo, 


where and V e denote the offspring and immigration variance, respectively, and the 

distribution of the random variable X is the unique stationary distribution of the Markov 
chain (X k ) ke z + . Klimko and Nelson [17] contains a similar results for the CLS estimator of 
(m^,m e ), and (11.11) can be derived by the method of that paper, see also Theorem 13.81 Note 
that E(X 2 ) and E(X 3 ) can be expressed by the first three moments of the branching and 
immigration distributions. 


If the process is critical, i.e., m £ = 1, then the probability of the existence of the estimator 
tends to 1 as n —* oo, and 


( 1 . 2 ) 


n[m 


(n) 


^ fp Xt d(A) - m e t) 

fo x t & 


as n —> oo, 


where the process (W)teiR + is the unique strong solution of the stochastic differential equation 
(SDE) 

dX t = m e dt + d>Vt, t e M + , 

with initial value X 0 = 0, where (Wt)t e R + is a standard Wiener process, and x + denotes the 
positive part of igR. Wei and Winnicki [57j proved a similar results for the CLS estimator 
of the offspring mean when the immigration mean is unknown, and (ll.2j) can be derived by the 
method of that paper. Note that dA") ——$■ X as n —> oo with X t ^ := n -1 Aq n q for t G M + , 
n G N, where |_ x\ denotes the (lower) integer part of iGl, see Wei and Winnicki [26] . If, 
in addition, — 0, then 


(1.3) 


n 3/,2 (m ^ 


(mi n) -1) 


V 


Af[0 3 -^ 


mt 


as n —> oo, 
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see Ispany et al. [13]. 


If the process is supercritical, i.e., m £ > 1, then the probability of the existence of the 
estimator m^' } tends to 1 as n —> oo, the estimator ] is strongly consistent, i.e., 

^ (n) a.s. , 

m £ —> as n —>• oo, and 


(1.4) 






_K±i)y \ 

+ 1 / 


as n —> oo. 


Wei and Winnicki 123 showed the same asymptotic behavior for the CLS estimator of the 
offspring mean when the immigration mean is unknown, and (11.41) can be derived by the method 
of that paper. 

In Section [2] we recall some preliminaries on 2-type Galton-Watson models with immigra¬ 
tion. Section [3] contains our main results. Section [4] contains a useful decomposition of the 
process. Sections 0 [6] and [7] contain the proofs. In Appendix [A] we present estimates for the 
moments of the processes involved. Appendix [B] is devoted to the CLS estimators. Appendix 
□ and □ is for a version of the continuous mapping theorem and for convergence of random 
step processes, respectively. 


2 Preliminaries on 2-type Galton—Watson models with 
immigration 

Let Z + , N, R and R + denote the set of non-negative integers, positive integers, real numbers 
and non-negative real numbers, respectively. Every random variable will be defined on a fixed 
probability space (h2,M, P). 

For each k,j E Z + and i, £ E {1,2}, the number of individuals of type i in the k th 
generation will be denoted by X k ^, the number of type i offsprings produced by the j th 
individual who is of type i belonging to the {k — l) th generation will be denoted by Ck,j,i/, 
and the number of type i immigrants in the k th generation will be denoted by e k ^. Then 
we have 

Ck,j,l,l 
£,k,j, 1,2 

Here {X 0 , £ kJ}i , e k : k, j E N, i E {1,2}} are supposed to be independent, where 


x k := 

'x K i 


£k,j,i, 1 


£k,i 


7 * 


i 

CM 

£k,j,i, 2 


£k,2 


Moreover, {£ k ,j,i : k,j E N}, {£ k ,j ,2 : k,j E N} and {e k : k E N} are supposed to consist of 
identically distributed random vectors. 


-k- 1,2 

E 

3 =1 


€k,j, 2,1 
£k,j, 2,2 


+ 


£fc, i 
£ fc ,2 


k E N. 


( 2 . 1 ) 


X k>1 

X k . 2 


M-i. 

E 

3 =1 
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We suppose E(||^ l ljl || 2 ) < oo, E(|| 1 2 1| 2 ) < oo and E(||ei|| 2 ) < oo. Introduce the 
notations 


:= E (^i,i,i) e K+, 


rri£ : = 


m 4l rr Hl 


px2 


m £ := E(ex) G M^_, 


Vc, := Var(^ 1;1 J G M 2x2 , V £ := Var(e 1 ) G M 2x2 , 

Note that many authors define the offspring mean matrix as mj. 
a(X 0 ,X 1 ,...,X k ). By (| 2 .ip, 


i e {1,2}. 

For k G Z + , let T' k := 


(2.2) E(X fc | Jfc.x) = X k _ hl m 5l + X k _ lj2 + m E = ra 4 W fc _i + m £ . 


Consequently, 
which implies 


E(X fc ) = E(X fc _i) + m £ , fceN, 


fc-i 

(2.3) E(X fc ) = raj; E(X 0 ) + m 2 m £ , fceN. 

3 =0 

Hence, the asymptotic behavior of the sequence (E(X k )) ke z + depends on the asymptotic 
behavior of the powers (m^) k£ ^ of the offspring mean matrix, which is related to the spectral 
radius r(m^) =: g G R + of m^ (see the Frobenius-Perron theorem, e.g., Horn and Johnson 
P, Theorems 8.2.11 and 8.5.1]). A 2-type Galton-Watson process (X fc ) fceZ+ with immigration 
is referred to respectively as subcritical , critical or supercritical if £>< 1 , f? = 1 or £> > 1 
(see, e.g., Athreya and Ney [lj V.3] or Quine [21]). We will write the offspring mean matrix of 
a 2-type Galton-Watson process with immigration in the form 


(2.4) 


: = 


a /3 

7 5 


We will focus only on positively regular 2-type Galton-Watson processes with immigration, i.e., 
when there is a positive integer k G N such that the entries of m| are positive (see Kesten 
and Stigum US)), which is equivalent to /3 ,7 G (0, 00 ), a, 5 G M+ with a + S > 0. Then the 
matrix m^ has eigenvalues 

__ a + S + y/(a - 5) 2 + 4/Jy __ a + S - y/(a - S) 2 + 4/37 

+ 2 ’ ” 2 ’ 

satisfying A + > 0 and —A + < A_ < A+, hence the spectral radius of m^ is 


(2.5) 


q = r(m $) = A + = 


a + 5 + \J (ex — 5) 2 + 4 /J 7 
2 


By the Perron theorem (see, e.g., Horn and Johnson [9[ Theorems 8.2.11 and 8.5.1]), 


A + k m^ —* u right it^ ft as k —> 00 , 
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where w r i g ht is the unique right eigenvector of m^ (called the right Perron vector of m^j 
corresponding to the eigenvalue A+ such that the sum of its coordinates is 1, and wi e f t is 
the unique left eigenvector of m^ (called the left Perron vector of m^) corresponding to the 
eigenvalue A + such that (bright, "“left) = 1, hence we have 


bright 


1 

(3 + A+ 



P 

1 

i ^left \ \ 

7 + A + - 6 

a 

A + — CM 

A+ - A_ 

/3 + A + — cm 


More exactly, using the so-called Putzer’s spectral formula, see, e.g., Putzer [2113, th e powers of 
can be written in the form 



\k 

k 'M 

■rrC = --_ 

A + -5 

P 

\ k _ 

+ 

A + — a 

~P 

( 2 . 6 ) 

€ A + — A_ 

7 

A_|_ — OL 

A + — A_ 

-7 

A + -S 


— A + Wrightleft T Aln r ightn left , k G N, 


where n r i g ht and ni e f t are appropriate right and left eigenvectors of m^, respectively, 
belonging to the eigenvalue A, for instance, 


bright 


— j3 — A_|_ + cm 

1 

— A_|_ + CM 

7 + A + - 5 

/3 + A + — cm 

13 


The process ( Xk)kez+ is critical and positively regular if and only if a,j 6 [0,1) and 
/?, 7 6 (0, oo) with a + 5 > 0 and /3y = (1 — a)(l — 5), and then the matrix m^ has 
eigenvalues A + = 1 and 

A_ = ck + 5 — le (—1,1) =: A. 

Next we will recall a convergence result for critical and positively regular 2-type CBI processes. 
A function / : M + — > M 0 ' is called cadlag if it is right continuous with left limits. Let 
D(IR + ,M d ) and C(M + ,M d ) denote the space of all IR^-vaiued cadlag and continuous functions 
on M + , respectively. Let DooC^-h M, d ) denote the Borel cr-held in D(M + ,M d ) for the metric 
characterized by Jacod and Shiryaev HI VI.1.15] (with this metric D(M + ,M d ) is a complete 
and separable metric space). For M d - va ] U ed stochastic processes CVf)teR+ and (y { t n ' > )teR + , 
n G N, with cadlag paths we write y <n> y as n —* oo if the distribution of y (n) on 
the space (D(R+, M d ), 'D 00 (M + , R. d )) converges weakly to the distribution of y on the space 
(D(M + , M d ), V 00 (R + , M d )) as n —> oo. Concerning the notation —¥ we note that if £ and 
£ n , n G N, are random elements with values in a metric space ( E , p), then we also denote by 
£ n —» £ the weak convergence of the distributions of £ n on the space (E, 13(E)) towards 
the distribution of £ on the space (E, 13(E)) as n —> oo, where 13(E) denotes the Borel 
a-algebra on E induced by the given metric p. 

For each n G N, consider the random step process 

x[ n) j, t el + . 


The following theorem is a special case of the main result in Ispany and Pap [121 Theorem 3.1]. 
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2.1 Theorem. Let (Xk)kez+ be a 2-type Galton-Watson process with immigration such that 
a, 5 E [0,1) and /3, 7 E (0, oo) with a + 5 > 0 and Pj = (1 — a)(l — 5) (hence it is critical 
and positively regular), X 0 = 0, E(||^ 111 || 2 ) < oo, E(||£ 112 || 2 ) < 00 and E(||erx|| 2 ) < 00 . 
Then 


(2.7) 

in D(M + ,K d ), 


(Wt )t£ R + 

where (. Z t ) teR+ 


•— (^i^right)teIR+ ^ t ZO 

is the pathwise unique strong solution of the SDE 


(2.8) d Z t = (n left , m e ) dt + y (V^uieft, u Mt )Zf dWt, t e K+, 

where (Wt)t e R + is a standard Brownian motion and 

2 PV^ + (1 - a)V €a 


Zq — 0 , 


(2.9) 


^ ^ ( e ii bright) 


i=l 


P T 1 — ot 


is a mixed offspring variance matrix. 


In fact, in Ispany and Pap |T2j Theorem 3.1], the above result has been prooved under the 
higher moment assumptions E(|| 1;1 1| 4 ) < 00 , E(||^ 1j12 || 4 ) < 00 and E(||£i|| 4 ) < 00 , which 
have been relaxed in Danka and Pap (6] Theorem 3.1]. 

2.2 Remark. The SDE (13.8ft has a unique strong solution (Z^) teR+ for all initial values 

(z) (z) 

Zq =z6l, and if z ^ 0, then Z) ; is nonnegative for all t G K + with probability one, 
hence Zf may be replaced by Z t under the square root in (13.81k see, e.g., Barczy et al. [4J 
Remark 3.3]. 

Clearly, depends only on the branching distributions, i.e., on the distributions of ^ y 
and £ 112 . Note that = Var(Y’ 1 | = u r i g ht)> where (Y fc ) fceZ+ is a 2-type Galton- 
Watson process without immigration such that its branching distributions are the same as that 
of (X t )kez + , since for each ze{l,2 }, = Var(TR | Y 0 = e,). 

For the sake of simplicity, we consider a zero start Galton-Watson process with immigration, 
that is, we suppose X 0 = 0 . The general case of nonzero initial value may be handled in a 
similar way, but we renounce to consider it. In the sequel we always assume m £ 0 , otherwise 
Xk = 0 for all k G N. 


3 Main results 

For each n G N, any CLS estimator 

CR Pn 
'T n 
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of the offspring mean matrix based on a sample X\,..., X n has the form 
(3.1) = B n A~ l 

on the set 


(3.2) Q n := {a; E 12 : det(A n (a;)) > 0}, 
where 

n n 

(3.3) A n : = Xk-iX k _ 1 , B n := y^(-X~fc — m e )X fc _ 1; 

k=l k =1 

see Lemma IB. II The spectral radius g given in (12.5|) can be called criticality parameter , and 
its natural estimator is the spectral radius of fn^\ namely, 


^ , (n)\ ®n T &n T \J (oi n S n J T 4 (3 n ^fn 

(3-4) g n := r(m^ ') =-----, 

on the set 12 n D f 1 n with 

(3.5) Q n \= {u G Vt n : (a„(w) - 8 n (uj)) 2 + 4/3 n (uj)%(uj) ^ 0}. 


First we consider the critical and positively regular case. By Lemma IB.61 P(f2 n ) —>• 1 and 
P(12 n ) —> 1 as n —> oo under appropriate assumptions. 


3.1 Theorem. Let {X k ) k£Z+ be a 2-type Galton-Watson process with immigration such that 
a, 5 € [ 0 , 1 ) and (3, 7 G ( 0 , oo) with « + 5 > 0 and /hy = (1 — a)(l — 5) (hence it is critical 
and positively regular), X 0 = 0 , E(||£i i,i|| 8 ) < 00 , E( 2 1| 8 ) < °°> E(||£i|| 8 ) < °°> and 

m e ± 0. 

If (V^uieft, uieft) + (14vleft, vi e ft) + (^left, ms) 2 > 0, then the probability of the existence of 
the estimator rn ^ tends to 1 as n —* oo. 

If (14ui e ft, ui e ft) > 0, then the probability of the existence of the estimator g n tends to 1 
as n —y oo. 


If (V^v left, f left )> 0, then 


(3.6) 

(3.7) 


n 1,/2 (m 


- m t ) A -J 1 


a 2 ) 1/2 vp-p y,,\w 


n(g n - 1) 


(V^WleftjVleft) 1 / 2 /q 1 (Vt dt 
v fo yt d(y f - tjuieft, m e )) 

In yt dt 


■V 


T 

left 5 


as n —$■ oo, with y t := (ui eft , M. t + tm e ), t e K+, where (Ait)teR+ is the unique strong 
solution of the SDE 

(3.8) dM t = ((uieft, M t + tm £ ) + ) 1/2 V^ 2 dW ( , t e M + M 0 = 0, 
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where (Wt)t G R + and are independent 2-dimenional standard Wiener processes. 

If (VgVieftjUieft) ^ 0 and (V £ v Mt . + (vieft, m £ ) 2 > 0, then 


(3,9) 

where 


-(n) 

— rri£ 


v 


X, + X 


4 T 
Vleft 


as n —> oo, 


Xi := 


2o : = 


X, : = 


X 4 := 


(uieft,m e ) 2 

r 

(1-A) 2 

[Jo 

( 1 ^^left ? ^left) f 

1-A 2 

Jo 

(uieft,m e ) / 

7 1 

1-A [ 

Jo 

(v e v Mt ,v Mt y/ 2 


V 2 dt- 


tfdt, 


r»l \ 2 

y t dt 


'0 


x 2 dt / ldM t - / (V t dt / y t dM ( 


t > 


rl/2 


(1 - A 2 )V2 


diV € ' / >' ( dW„ 


3.2 Remark. If (V^ieft, theft) + (K--theft, theft) + (theft, "ie) 2 = 0 then, by Lemma IB.41 (1- 

! =' j3Xk^ f° r ah k £ N, hence there is no unique CLS estimator for the offspring mean 
matrix m £. □ 

3.3 Remark. By Ito’s formula, (j3.8j) yields that (34)teR+ satisfies the SDE (12.8p with initial 
value y$ = 0. Indeed, by Ito’s formula and the first 2-dimensional equation of the SDE (I5.3[) 
we obtain 

dx = <u left , m e ) d t + (yf) l/ 2 uJettvl ' 2 dWt, t £ K+. 

If (V^Uieft, Mieft) = 1| 2 = 0 then uJ oit V ^= 0, hence dy t = (u Mt ,m £ )dt, t£R+, 

implying that the process (3^t)teR + satisfies the SDE (|2.8j) . If (V^rt le f t , w left ) y o then the 
process 


W:= 


(V^ /2 u Mt ,Wt) 


t £ 




(V^Uleft, Wleft) 1/2 

is a (one-dimensional) standard Wiener process, hence the process (W)teR+ satisfies the SDE 

(im 


Consequently, (34)teR+ = (Z t ) te R + , where (Z t ) te ^ is the unique strong solution of the 


SDE (12.811 with initial value X 0 = 0, hence, by Theorem 12.11 
(3.10) (X^ 


T) V 

t (<^t)t£R_|_ ((Vfbright)tGR+ aS Tl ^ OO. 

If (V^ it i e ft, it left) = 0 then the unique strong solution of (j2.8(1 is the deterministic function 
y t = (itieft, m e ) t, t £ M + , and then, in (13.61) . we have eventually asymptotic normality, since 

/f/ 2 dW t c 


id y* dt 


= *( o^Ve), 


and by (13.71) . n(p n — 1) —> 0, i.e., the scaling n is not proper. 


□ 




























a.s. 


3.4 Remark. Note that (V^itieft, ttieft) = 0 is fulfilled if and only if (wieft, £k,j,i) = 
(uieft.E^u J) for each k,j G N and i G {1,2}, i.e., the offspring point lies 

almost surely on a line, orthogonal to Ui e ft and containing the point E(^ lli ). Indeed, 
(V^Uieft, iti ef t) = 0 is fulfilled if and only if (V^.u left , uieft) = E[(wieft, £ kJti -E(£ fc ,yi)) 2 ] = 0 for 
each k, j G N and iG{l,2}. 


In a similar way, (V^ni e f t , ni e ft) = 0 is fulfilled if and only if (ni e f t , £k,j,i) = ('Uieft, E(^ 1>1 j)) 
for each fc,j G N and i G {1,2}, i.e., the offspring point £,k.j,i lies almost surely on a line, 
orthogonal to Ui e f t and containing the point E(£ x X i ). □ 


3.5 Remark. We note that in the critical positively regular case the limit distribution for the 
CLS estimator of the offspring mean matrix m £ is concentrated on the 2-dimensional subspace 

C M 2x2 . Surprisingly, the scaling factor of the CLS estimators of m^ is y/n, which is 
the same as in the subcritical case. The reason of this strange phenomenon can be understood 
from the joint asymptotic behavior of det(A n ) and D n A n given in Theorems 14.11 and 14.21 
One of the decisive tools in deriving the needed asymptotic behavior is a good bound for the 
moments of the involved processes, see Corollary IA.61 □ 

3.6 Remark. The shape of J]' Tt d(V^' 2 VVtU l } ft ) / Jj, 1 W df in (13.6[) is similar to the limit 
distribution of the Dickey-Fuller statistics for unit root test of AR(1) time series, see, e.g., 
Hamilton [8] 17.4.2 and 17.4.7] or Tanaka [24; (7.14) and Theorem 9.5.1], but it contains 
two independent 2-dimensional standard Wiener processes, which can be reduced to three 1- 
dimensional independent standard Wiener processes. This phenomenon is very similar to the 
appearance of two independent standard Wiener processes in limit theorems for CLS estimators 
of the variance of the offspring and immigration distributions for critical branching processes 
with immigration in Winnicki [29] Theorems 3.5 and 3.8]. Finally, note that the limit distri¬ 
bution of the CLS estimator of the offspring mean matrix m^ is always symmetric, although 
non-normal in (13.61) . Indeed, since (W<)tgR + and (W()a + are independent, by the SDE 
(13.811 . the processes (At)teR+ an d (Wt)tgR + are also independent, which yields that the limit 
distribution of the CLS estimator of the offspring mean matrix in (13.6p is symmetric. □ 


3.7 Remark. We note that an eighth order moment condition on the offspring and im¬ 
migration distributions in Theorem 13.11 is supposed (i.e., we suppose E( x ill 8 ) < oo, 
E(||^m, 2 l| 8 ) < oo and E(||ei|| 8 ) < oo). However, it is important to remark that this con¬ 
dition is a technical one, we suspect that Theorem 13.11 remains true under lower order moment 
condition on the offspring and immigration distributions, but we renounce to consider it. □ 


In the subcritical case we have the folowing result. By Lemma IB. 71 P(Q n ) —> 1 and 
P(Q n ) —> 1 as n —> oo under appropriate assumptions. 

3.8 Theorem. Let (Xk)kez+ be a 2-type Galton-Watson process with immigration such that 
a, 5 G [0,1) and /3,7G(0,oo) with a + S > 0 and /3y < (1 — a)(l — 5) (hence it is subcritical 
and positively regular), X 0 = 0, ®2(||^i || 2 ) < oo, E(||^ 1j12 || 2 ) < oo, IE(||grx|| 2 ) < oo, 
m e ^ 0, and at least one of the matrices V^, V^ 2 , V e is invertible. Then the probability 
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of the existence of the estimators m^' 1 and tends to 1 as n —* oo, and the estimators 

m!'^ and g n are strongly consistent, i.e., fri^ l> Ely m^ and g n Ely g as n —> oo. 

If, in addition, E(||^i i i j i|| 6 ) < oo, E(||^ 112 || 6 ) < oo and E(|||| 6 ) < oo, then 


(3.11) n 1 / 2 (ra^ l ' ) — m^) Z, 

(3.12) n 1/2 {g n - g) A Tr(RZ) = J\f(0, Tr [R® 2 E(Z® 2 )]), 


as n —> oo, where Z is a 2x2 random matrix having a normal distribution with zero mean 
and with 


E(Z® 2 ) = - E(£ 1-U ))«] E 


i=l 


xAx 


T\ 8> 2 


+ E[( £l -E(ei))® 2 ] E 


X 


-T 


E XX 


-i 


where the distribution of the 2-dimensional random vector X is the unique stationary distri¬ 
bution of the Markov chain ( X k ) keZ+ , and 


R : = (Vr(m^)) T 



1 

2 v / (a - 5) 2 + 4/^7 


a — 5 
2 7 


2/3 

5 — a 


We suspect that the moment assumptions might be relaxed to E(|| : x || 3 ) < oo, 
EdKmgU 3 ) < oo and E(11e 1 11 3 ) < oo by the method of Danka and Pap j6j Theorem 3.1]. 


4 Decomposition of the process 

Applying (12.2h . let us introduce the sequence 

(4.1) M k := Xfc — E(Xfc | Tk-i) = X k — m^X k ~i — m e , keN, 

of martingale differences with respect to the filtration (Xk)k£Z + - By (14.11) . the process 

( X k )kez+ satisfies the recursion 

(4.2) X k = m^X k _i + m £ + M k , k e N. 

By (13.1ft . for each n G N, we have 

my - m $ = D n A n 

on the set given in (13.21) . where A n is dehned in (13.3ft . and 

n 

D n :=J2 M k X k-i, »eN. 

fc=i 
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In the critical case, by f!3.10p and Lemmas 1C.21 and 1C.31 one can derive 

^ A n y I dt bright ^right ■ 

Jo 


as n —> oo. 


Indeed, let us apply Lemma 1C.21 and Lemma 1C.31 with K : [0,1] x K 2 —* K 2x2 , 

K(s, x) := xx T , (s, x) G [0, 1] x M 2 , 

and U := X, U n := X (n) , n e N. Then 

|| K(s,x) - K(t,y) || = \\xx T - yy J \\ = \\xx T - yx T + yx T - yy\\ 

^ ||a; — y||||jc|| + ||y|||| a; — y|| ^ 2f?(|£ — s| + ||£E — y| 


for all s,t G [0,1] and x,y 6l 2 with ||a;|| ^ R and ||y|| ^ R, where R > 0. Further, 
for all n E N, 


®n{X {n) )= ( Afi n) ,-V* 

\ n 


,(n) . 

' /c/n' 


V 

k/n / 


= -x 


k =1 


n 


m q 

n 6 




k =1 


*{X) = Xu 


X U X T d u 


Using that, by (13.101) . (X n ,X n ) -y- (X,X) as n — » oo and that the process (A)i g R + 
admits continuous paths with probability one, Lemma 1C.21 (with the choice C := C(R + ,M)) 
and Lemma 1C.31 yield that 

1 n pi pi 

n- 3 A n = — Vx.Xj A / X u X T u du= / (^n rig ht)(y^n g ht) T d M = A 

n Jo Jo 


as n —> oo. However, since det(A) = 0, the continuous mapping theorem can not be used 
for determining the weak limit of the sequence (n 3 A“ 1 ) ne N- We can write 

(4.3) ml n) - = D n A~ l = 1 D n A n , n e N, 

dct yA. n j 

on the set Q n , where A n denotes the adjugate of A n (i.e., the matrix of cofactors) given by 


A„ := E 

k=1 


X 


2 

fc — 1,2 


-Xk-i,iX k _ 


1,2 


~X k _iiX k _x t 2 


X 


2 

fc — 1,1 


n G N. 


In order to prove Theorem 13.11 we will find the asymptotic behavior of the sequence 
(det(A n ), D n A n ) ngN . First we derive a useful decomposition for X k , k G N. Let us 
introduce the sequence 


U k • (^left) XfJ) 


(7 + 1 — 5)X k} 1 + (/3 + 1 — a)X k) 2 
UA 


k e z+. 
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One can observe that Uk ^ 0 for all k G Z + , and 


(4.4) 


Uk Uk—1 "b ('l^left) WIe) ~t~ (^lcft) k G LT, 


since (iti e ft, m^Xk-i) = uJ e{t m^X k -1 = -u^ ft A4_i = Uk- 1 , because ui e f t is a left eigenvector 
of the mean matrix m^ belonging to the eigenvalue 1. Hence ( Uk)kez + is a nonnegative 
unstable AR(1) process with positive drift (ui e f t ,m £ ) and with heteroscedastic innovation 
((n left , M k ))k£N- Note that the solution of the recursion (14.4j) is 

k 

(4.5) U k = y^(ttieft, Mj + m e ), k G N, 

3 =1 

and, by Remark 13.31 and Lemma 1C.21 

(4.6) (n~ 1 Ui n tj)te«. + = ((«i e ft, ^ ( t n) ))te«.+ -^4 ((itieft, X t )) teR+ = ((R)teM+ as n -> oo, 


where ((Vt)teR + is the pathwise unique strong solution of the SDE (12.8ft . Moreover, let 


14 • ("Oeft> X-k) 


Note that we have 


— (1 — a)X k) i + f3X kt 2 

/3 1 — o 


k G Z+. 


(4.7) 14 = AVfc_i + (vieft, m e ) + (vieft, M fc ), k G N, 

since (i>i e f t , m^X k -i) = vJ eft m^X k -i = XvJ eft X k -i = A14-i, because v le f t is a left eigenvector 
of the mean matrix belonging to the eigenvalue A. Thus (14)fceN is a stable AR(1) 
process with drift {v\ e ^,m e ) and with heteroscedastic innovation {{v\ e ^,Mk))km- Note that 
the solution of the recursion (14.71) is 

k 

(4.8) = X] A fc - J >ieft, Mj + m e ), fcGN. 

3 = 1 

By (12.IK and (14.11) . we obtain the decomposition 

Xk-1,1 Mt-1,2 

(4.9) M k = Y, fe,i - + E fe,.- E M + b- E M. 

1=1 1=1 

Under the assumption (V^vieft, Uieft) = 0, by Remark 13711 we have (vi e ft, £k,j,i ~ m^)) = o 
for all k,j G N and i G {1,2}, and hence (vi eft ,M fe ) =' (vi e f t , e k - E(e fe )), implying 
(vieft, M k + m £ ) =' (v left , £ fc ) and, by (@77]), 

(4.10) Vk = A 14-i + (vi e ft,£fc), k G N. 

The recursion (I4.2[) has the solution 

k 

X k = Y^ m k f j (m £ + Mj), ke N. 

3 =1 
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Consequently, using (I2.6f) . 

k 


X k — 'y ^ (Wj-ightWieft + A " J V right V left ) ( TTl E + Mj) 

3 = 1 

k k 

— bright u \ e ft ^ 'j -X j ~ ITl^X j_l) + bright ^left ^ ^ A ~*(Xj — TTl^Xj_\) 


3 = 1 
k 


3 =1 


= ^ ight ^ ft Ew - ^-i)+E i xk ~ jx i - ^ i+ 1 Xj-i] 

j =i i=i 

U r ig}it/Uj fJ f|AC k . T H right ^ left "^^4 £4 bright -|- V k V r [ ght) 


hence 

(4.11) X k = 

This decomposition yields 


Xr’ 





u k 


1 

CN 

-S<f 

_1 


bright 

^ right 


v k _ 



^71—1 \ / 71—1 


P TT _ P+l-a -tr 

/3+1-a fc 1—A fc 

+ TT* 1 * 


'n—1 


k e Zj 


(4.12) 


since 


det(A„) = E^ E V ‘ ~ ■ 


vfc=l 


,fc=l 


,fc=l 


det(A n ) = det ( E^4-i^I-i 


,fc=i 


= det 


bright bright | ^ ' 
k =1 


£4-i 

14-1 


£4-i 

Vfc-i 


T 


bright bright 


det E 


fc=i 


E-i’ 


~u k _i 


r.h 


M 

.14-!. 


.14-i. 


det ( 

V 

bright bright 

) 


/ 



/ J 


where 

(4.13) 


det 


bright bright 


= 1. 


Theorem 13.11 will follow from the following statements by the continuous mapping theorem 
and by Slutsky’s lemma. 
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4.1 Theorem. Suppose that the assumptions of Theorem \3 . 1\ hold. If (VgVi 0 ft, theft) > 0, then 


n 5 / 2 Uk_iVk-\0 as n —> oo, 
k =i 


n 


E 


[ ri-Yl 1 1 



n-Yl, 


( v left i v left) fl A; Jr 

i_ A 2 Jo yt 

n~ 2 M k U k -1 


fo y< jh 

n~ 3 / 2 M k Vk-i_ 


^0^vf 2 py t d\v, 


as n —> oo. 


In case of (V^theft, theft) = 0 the second and fourth coordinates of the limit vector of the 
second convergence is 0 in Theorem 14.11 thus other scaling factors should be chosen for these 
coordinates, described in the following theorem. 


4.2 Theorem. Suppose that the assumptions of Theorem, 1,9. 1\ hold. If (V$ theft, theft) = 0, then 




fc-i 


k =i 


(^heft; rtX e ) theft) ^left ) 

(1 — A) 2 l^Y 2 


= : M 


as n —>■ oo, 


n 


E 


n- 3 Ul i J 


fo y 2 t dt 


v ^ 

<”“> Jo'y.di 

n~ 2 M k U k _i 



n~ 1 M k V k -i 


(Mil) Ml + iV<vp^y>yl/2jl y f d yy t 


as n —> oo. 


Proof of Theorem 13.11 In order to derive the statements, we can use the continuous mapping 
theorem and Slutsky’s lemma. 

Theorem 14.II implies (13.6j) . Indeed, we can use the representation (14. 3p . where the adjugate 
A n can be written in the form 


A n = 


-1 0 


Ew-wy 


i=i 


0 -1 

1 0 


n G N. 


Using (14.lip , we have 


D n A n — M k 

k=\ 

Here we have 

n T 

“right 
V T 

. right. 


Y 

1 

T 

^right 


1 

1-1 

o 

1_ 


11 T 

“right 

S W4 

b 

s 

1 

_1 


Y 

1 

_i 

T 

^right 


1 

t-H 

1 

O 

i_ 

1 

1_ 


V T 

_ u right. 


-1 0 


,,T 

.right. 



7/_i. 


right. 


1 0 


0 1 

-1 0 


?/ T 

“right 

T 


V 


right _ 


T 


o 1 

-1 o 


u 


T 

right 


V T 

. right J 


0 -1 

1 0 


— V 


u 


T 

left 

T 

left 
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Theorem 14.11 implies asymptotic expansions 




k =1 


E 


t =1 


£4-i 

V<_i 


C4-i 

7fc-i. 

'£4-i 

^-i 


T 


= n 2 D n , i + n 3 / 2 D n 2, 


— w? A n i + rC’^ A n 2 + n 2 A 


n,3i 


where 


£>n,i := n 


n r.\ 

- 2 VMA_ ie |A y t dM t e^=:!»!, 

fc=i 


At ,2 :=w- a/2 X)M fc y fc _ ie J A = V 


k =1 


2, 


A»,i := n 

i=\ 

7 

A„, 2 := n’ 5 ' 2 V 


1 

^ to 

O 

_i 

A [ y 2 dt 

1 

o 

_i 

i 

O 

o 
1_ 

Jo 

0 0 


=: A 


1) 


£=1 


0 Ui-iVi-i 

Ut-iVt-1 0 


n 


0, 


^n,3 := n 2 y^ 


£=1 


0 0 

A fy.&t 

l 

O 

o 

1_ 

o 

i K 

i_ 

1 - A 2 J o 

0 1 


*4.3 


jointly as n —> oo. Consequently, we obtain an asymptotic expansion 


= (ra 2 A,i + n 3/2 £>„, 2 ) 


0 1 

-1 0 


(n 3 A nj i + n 5/2 A U}2 + n 2 A n ^) 


-v 


left 


It 


left 


= (n 5 C njl + A 2 A ,2 + n 4 C n , 3 + n 7/2 C n , 4 ) 


—v 


u 


T 

left 

T 

left 


where 


C n ,l ■ D n i 


0 1 

-1 0 


A n>1 = n~ 5 J2Yl MkUk^U^eJ 


k =l £=i 


1 

T—1 

o 

1_ 


1 

o 

1—1 

1_ 

1 

1 

H 

( o 


0 0 


= 0 
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for all n G N, and 



’ 0 

l" 




’ 0 

l" 



’ 0 

l" 

D n: i 



A, 2 

+ 

D n , 2 



A,i 





-1 

0 




-1 

0 



-1 

0 


’ 0 

l" 




’ 0 

l" 


T) 

’ 0 

r 

D n ,\ 



A n , 3 

+ 

D n ,2 



A,2 





-1 

0 




-1 

0 



-1 

0 


M, 


VJ; 


Cn,4 • D n 2 


0 1 

-1 0 


A 


v 


n, 3 




o 1 

-1 o 


A: i 


as n —> oo. Using again Theorem 14. 1 1 and (14.12b we conclude 


n 5 det(A„) 

n~ 9 / 2 D n A n 


v 


Vo 


0 1 

-1 0 


A 


—v 


u 


T 

left 

T 

left 


as n oo. 


Here 


Vo 


0 1 

-1 0 


A 


— V 


u 


left 

T 

left 


V leit ) 1 / 2 f L 2 —1/2 f 1 ~ T 

(!-*)■/. x y ‘ itVi X y,dW,£2 


o 1 

-1 o 


1 o 
o o 


—v 


u 


left 

T 

left 


( V^v left, V left) ^ f a;2 TT 1 / 2 f a; iaai T 

= (1 - y)l/2 X ^ d * V t X 3 , ‘ dW * B W 

Since m £ ^ 0, by the SDE (12.81) . we have P(3X = 0 for all t e [0,1]) = 0, which implies 
that P(/ () 1 y 2 dt fy y t dt > 0) = 1, hence the continuous mapping theorem implies (13.6ft . 

For the proof of (13.7j) , we can write — 1 in the form 


Qn 1 Qn Q 


{a n — a) + (8 n — 5) + J (a n - 8 n ) 2 + 4fi n % - ^(a - 8) 2 + 4/3y 


(cr n o) T (<5 n h) 


+ 


[(an - a) - A - 5)] [{a n + a) - (S n + 5)] + 4(/3 n - /3)% + 4(y n - 7)/3 


2/y (ot n — 8 n ) 2 + 4/3 n 7 n + y/(ot — <5) 2 + 
Cn 


& n “1“ 4/3tt.'Ytt, H - (1 
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where 


C n • (c^n Ot) (oi n 5 n )^ “1“ 4/3 n 7n -|- (1 A) T (oi n T Of) fi n T 5) T 4 (f3 n fifi/-, 


+ 4 ( 7 n — 7 )/? + (5 n — 5) y (a n — 5 n ) 2 + 4 / 3 n 7 „ + (1 — A) — (a n + a) + (5 n + 5) 


Slutsky’s lemma and (13.6p imply — m^ —> 0 , and hence rri^ — m^ ^ 0 as n —> oo 

^ P 

Thus 7 n — > 7 , and 

(a n + a) — ( S n + 5) —> 2(a — 5), 

(a n — 5 n ) 2 + 4/3 n 7 n —> (a — 5) 2 + 4/37 = (2 — a — Sfi = (1 — A) 2 


as n —> oo. The aim of the following discussion is to show n(c n — d n ) —> 0 as n —> oo 
where 

d n ■— (oi n — a) [ 2(1 — A) + 2 a — 25] + 4(/3 n — (d)'y 
+ 4(7 n — 7 )^ + (8 n — 5) [2(1 — A) — 2 a + 25] 

= 4(1 - 5)(a n -a) + 47 0 n - /3) + 4/3(% - 7 ) + 4(1 - oi){fi n - 5). 


We have 


n(c n 



5n) 2 + 4/3n7n 


(1 - A) {(a r 


— a) + (5 n — 5)] 


+ n[(a n -a) - (5„ - 5 )] 2 + 4n(/3 ri - /3)( % - 7 ), 


where 


\J («n - 8n) 2 + 4^n7n “ (1 ~ A) 

[(Sn - a) - (5„ - 5)] [(a n + a) - (5„ + 5)] + 4(/3 n - /3)% + 4(7 n - 7 )^ 
\/ ( a n — 5 n ) 2 + 4/3 n 7 n + (1 — A) 


hence n(c n 


dn) 



0 as n —> 00 will follow from 


(4-14) 


n{ [(a n 

X [(®n 


n 



— a) — (5 n — 5)] [(a n + a) — (5 n + 5)] + 4(/3 n — 

— a) + (5 n — 5)] 

(«n — ^n) 2 + 4/3„7 n + (1 — A) 

(a n -a) - (5 n - 5)] 2 + 40 n - (3)(% - 7 )} 


P)ln + 4(7n — 7)/3} 


0 as n —» 00 . 
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By (13. 6 p we have 

n 1/2 (m^' ) - m^j -A CV^ 2 j y t dW t vJ eit as n -> oo 

with 

c ;= (1 - A ) 1 / 2 

{v s vi e ft, »*,)•/* // y t d t 

Consequently, 


vd^ 2 (ci n — a) 




— (1 — a)eJX 

n 1/2 0 n ~ P) 

Ac 


C 

pejT 

n 1/2 ( 7n - 7 ) 


4v/ / 7o 1 3 ; «dW,t.i l e I 

(3 -I - 1 — o? 

-(! - ot)eJX 

1 

1 

/ g 


.4y 1/ 7„ 1 J , .dW,< l e 2 . 


Pejl 


as n —* oo with X := V0 J ( ] y t dWt- 


By continuous mapping theorem, 


n{a n — a) 2 

n(a n - a)0 n — /3) 

n(a n - a )(% - 7 ) 

^(^n ^)(8 n 

n(Pn - P){% - 7 ) 
n(p n — P)(6 n - 8) 
n i% ~ 7)(<5n - 

n(8 n - 8) 2 



C 2 

(/3 + 1 - a) 2 


(1 - a) 2 X T ei e7X 
-(1 -a)pX T ei eJZ 
(1 - a) 2 X T e ie JX 
-(1 - a)^X T e ie JX 
-(1 - a)^X T e ie JX 
f3 2 I T e\ejT 
-(1 - a)/3X T e 2 eJX 
/3 2 X T e 2 eJX 


as n —» 00 , and by continuous mapping theorem, Slutskys lemma and m!0 — 
n —> 00 , we conclude H4.141) . since 

2(a - <5) [(1 - a) 2 e 1 e ] r - /3 2 e 2 e^] + 47 [-(1 - a)/3eie 1 r + /3 2 e A] 

+ 4/3 [(1 - a) 2 e A - (1 - a)/3e 2 ej] 

+ 2(1 - A) [(1 - a) 2 e 1 ej + 2(1 - a)/3e A + /8 2 e 2 eJ - 4(1 - a)/3e A] 
= e 1 ej [2(a — <5)(1 — a) 2 — 4/37(1 — a) + 2(1 — A)(l — a) 2 ] 

+ [4/3 2 7 + 4/3(1 — a) 2 — 4/3(1 — cr)(l — A)] 

+ e A [-2/3 2 (a - 8) - 4/3 2 (l - a) + 2/3 2 (l - A)] = 0. 

Consequently, (13.71) will follow from 

nd n v fn yt d(34 - t(u Mu m e )) 


(4.15) 


[a n — 8 n ) 2 + 4/3„7 n + (1 — A) 


Jo yt dt 


as 
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as n —> oo. We can write 


d n = 4(1 — 6)eJ (m^ — m^)e i + 47 ej (m^ — m^)e 2 
+ 4/9eJ (m^ — m^)e 1 + 4(1 — a)e^" (m^ — m^)e 2 . 

We use again the representation (14.31) and the asymptotic expansion of D n A n . 


-Dn,l 


D 


0 1 

-1 0 


l n,2 


-V 


T 

left 


U 


T 

left 


= - n ~ 9/2 


n,2 


0 1 
-1 0 


-4n,l 


V 


u 


T 

left 

T 

left 


= n-o' 2 


EE M kUk-iUi-iVi-ivJ e{t , 

k =1 £=1 

71 71 




implying 


(l-5)ejD 


71,1 


0 1 

-1 0 


A n , 2 e i + 7 e 7-^M 


fc=i i=\ 


0 1 

-1 0 


^4-n,2 e 2 


+ f3e~l D U) 


(1 -5)ejD 


0 1 

-1 0 


A-n^e-i + (1 — a)ejD U) 


0 1 

-1 0 


71,2 


0 1 

-1 0 


^■n,l e l + 7 e i~-^n.,2 


0 1 

-1 0 


A n)2 e 2 

^4?i,l e 2 


—V 


u 


T 

left 

T 

left 


+ P e 2 D n , 


for all n 6 N, and 


0 1 

-1 0 


^ 4 . 71,161 + (1 — a)e 2 D 


71,2 


(l-S)ejD 


71,2 


0 1 

-1 0 


4„, 2 e 1 + 7 ejD Ut 


0 1 

-1 0 


0 1 

-1 0 


^4n,l e 2 


-V 


T 

left 


U 


T 

left 


A n2 e2 


+ 8e7 2 D 


2 J - y n,2 


0 1 

-1 0 


^ 4 ?!, 2 e l + (1 — a ) e 2 


0 1 

-1 0 


- 4 - 71 , 2^2 - > 0 


as n —y 00 . Moreover, 


T>! 


0 1 

-1 0 


-v 


u 


T 

left 

T 

left 


^left) 

TYv 


y t d t / y t &M t u T 


left • 


We have 


= 0 , 


= 0 
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Using again Theorem 14.11 and (14.12p . we conclude 


nd n 


v 


OCn — <5n) 2 + + (1 — A) 

1 


^ [ ytdMtuUe 1 + 'yeJ f y t dM t uJ eit e 2 

(1 - A) J 0 yfdt \ Jo Jo 

+ /3eJ / y t dMt uj e{t e 1 + (1 - a)ej f y t d M t uj eit e 2 
Jo Jo 

- S)(j + 1 - 5) + 7(/3 + 1 - a)]ej f y t &M t 


y t dM> 


" (l-A)Vo^dt 

+ [/3( 7 +l-<5) + (l-<5)(/3 + l-a)] 

= - - . 7T ,, 2 , + 1 - 3) e i [ yt dA4 f + {fJ + 1 - a)ej f y t d.M t ^ 

(1 - A) J 0 yf at V Jo Jo J 

deleft, M t ) _ /p 1 y t d(y t ~ t(ltieft, m e )) 

fo 1 yt dt £ y 2 t d t 

as n —> 00 . 

Next we show that Theorem 14.21 yields (13.9p . Theorem 14.21 implies asymptotic expansions 


£ M * 


k =1 


£ 

e =1 


U e -1 

U,_! 


E4-i 

U fc _i 

Vl 

U ,_1 


= n 2 D n) i + mD ni 


2, 


n A n>1 T n A n ^ T nA . n ^ 


3, 


20 



























where 


n „i 

D ntl :=n- 2 y2 M kU k -ieJ A / ^dM 

fe=i • /o 

n 

D n ,2 := ^ _1 ^ M k V k _ x e[ 


t e7 — : 


fc=i 

A M , + d w) 4 == ®» 


A n ,i := n 3 

£=1 

n 

An ,2 := n- 2 ^ 


TT 2 

1 

0 

A A 

J 2 d t 

1 

1 

O 

0 

0 

Jo 


0 

0 


i=i 


0 Ug-iVi-i 

Ui-iVe-i 0 


—: Ai, 

(vieft, m e ) f l 

1-A 


f 1 9 

0 1 " 

/ 34 2 dt 
Jo 

l 

O 

1 _ 


l 2, 


^n,3 := n 1 ^ 


£=1 


0 0 
0 


Xy Z' (^left) (^e^left; ^left) \ 

^ V (i — a) 2 ; 


o o 
o 1 


=: -4.. ! 


jointly as n —> oo. Consequently, we obtain an asymptotic expansion 


D n A n = (n 2 D rl} i + nD 


n,2j 


0 1 

-1 0 


(n 3 A nj i + n 2 A n , 2 + nA n , 3 


-v 


T 

left 


U 


T 

left 


— (n 5 C n ,i + n 4 C rej 2 + vC’Cn^ 3 + n 2 C n , 4 ) 


—v 


u 


T 

left 

T 

left 


where 


and 


C n ,i D 


n, 1 


0 1 
-1 0 


A^ 1 = 0 for all neN, 


C n A . A) r 



’ 0 

1" 



’ 0 

1" 



’ 0 

1" 



’ 0 

i 

D U) 1 



An t 2 

+ D U: 2 



- 4 - 71,1 




< 4-2 

+ T ^2 




-1 

0 



-1 

0 



-1 

0 



-1 

0 


’ 0 

1" 



" 0 

1" 


t> 

’ 0 

1" 

• 4-3 


’ 0 

i 

^n,l 



- 4 - 71,3 

+ -D n) 2 



4 - ra , 2 




+ ^?2 




-1 

0 



-1 

0 



-1 

0 



-1 

0 


’ 0 

1" 


V 

’ 0 

1 









D n> 2 



4 . n , 3 

^T > 2 



>43 









-1 

0 



-1 

0 










A 


l) 


*■ 2 ) 
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as n —¥ oo. Using again Theorem 14. 1 1 and (14.121) . we conclude 

f 1 ^ 2 a +( (Uleft,m e ) 2 , (Vir>l e ft,Ul e ft) A («1 eft^e) 2 ( f 1 

Jo in ^ (1 _ A )2 I X _ A 2 J 


n 4 det(A n ) 

ti D n A n 


as n —)■ oo. Here 


£>i 


0 1 

-1 0 


-v 


T 

left 


U 


left 


XL 


(i— a ) 2 [fo yt&t 

0 1 . -V 


-1 0 


A 


T 

left 


U 


T 

left 


2 ^ f (^lefti Wle) , (^e^leftn ^left) ^ (^left? 

2 


L yti \ d-w 


+ 


l- a 2 ) ii-xy 


^1 \ 2 

34 dJ ) = X\ + X 2 , 


'0 


X>i 


0 1 

-1 0 


—v 


u 


left 

T 

left 


^ ytAt fy iAMte T 


1-A 


(theft, rn e ) 

1-A 


0 1 

-1 0 


34 dt / 34 dM t u T 


left 


and 

£>2 


0 1 
-1 0 


" 

„,T 

A 

V left 

1 

g 

oT ~\ 

1_ 


-1 


= / 34 2 dJ ' ^ left ’ me) 


'0 


1-A 


At! 


(V e V i eft , Vjeft) 1 / 2 —1/2 f 1 


-1 


= / 34 2 dt( 


'0 


1-A 


(1 - A 2 ) 1 / 2 Jo 

<U»l.f«,'»l.ft> 1/2 T 7 l/2 f 1 
(1 - A 2 )l/2 « /, 


v? y,<m,\e 


„T 


0 1 
1 0 


0 1 

-1 0 


34 dWt ] v^. 


-v 


u 


1 0 
0 0 


T 

left 

T 

left 


-V 


T 

left 


U 


T 

left 


Since m e y 0, by the SDE (12.81) . we have P(34 = 0 for all t G [0,1]) = 0, which implies 
that P(/ 0 1 34 2 d t fy 34 d t > 0) = 1, hence the continuous mapping theorem implies (13.91) . □ 


5 Proof of Theorem 14.11 


The first convergence in Theorem 14.11 follows from Lemma IB.31 

For the second convergence in Theorem 14.11 consider the sequence of stochastic processes 


Mi 


for t G M + and k,n G N, where <g) denotes Kronecker product of matrices. The second 
convergence in Theorem 14.11 follows from Lemma IB.21 and the following theorem (this will be 
explained after Theorem 15. ip . 



At'” 1 ' 

L nt\ 

s 

1 

£ 

_i 


n 1 

2<"> := 

A/1" 1 

:= ^ with Z^ : = 

n 2 M k U k -i 

= 

n~ 2 U k -i 


'pin) 

k=\ 

n~ 3 / 2 M k V k -i 


1 

CO 

to 
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5.1 Theorem. Suppose that the assumptions of Theorem \4fjj hold. Then we have 
(5.1) Z^ —>■ Z as n —> oo, 

where the process (S t ) teK+ with values in (R 2 ) 3 is the unique strong solution of the SDE 


(5.2) 


dZ t = 7 (t,Z t 


dVV t 

d W t 


t G 


M-j 


with initial value Zq = 0 , where (Wt)a + and (Wf)( 6 i + are independent 2-dimensional 
standard Wiener processes, and 7 : R + x (R 2 ) 3 —>■ (R 2x2 ) 3x2 i s defined by 


7 (t, x) 


((u Mt ,x 1 + tm E ) + ) 1 /‘ 2 
((theft) X\ + tm e ) + ) 3/2 
0 


0 

0 


(1-A 2 )V2 


(ni eft ,xi + tm £ ) 



for t G R + and x = (xi,x 2 ,x 3 ) G (R 2 ) 3 . 


(Note that the statement of Theorem 15.11 holds even if (V^ni eft , ni e f t ) = 0, when the last 
2 -dimensional coordinate process of the unique strong solution (Z t ) t& «. + is 0 .) 

The SDE (15. 2 p has the form 




"d Mt 


((wieft, M t + tm E )+y / 2 V ^ 1/2 dW t 

(5.3) 

dZ t — 

dAft 

= 

«w left , Mt + tm £ ) + y/ 2 vl /2 dW( 



_d V t 


(wieft, M t + tm E ) dW t J 


One can prove that the first 2-dimensional equation of the SDE (15.31) has a pathwise unique 
strong solution (Al| yo ^)t e M + with arbitrary initial value = y 0 G R 2 . Indeed, it is 

equivalent to the existence of a pathwise unique strong solution of the SDE 

f d<S t = (w left , m e ) d t + (S+y / 2 < ft vf 2 d\V t , 

(5.4) { _ t G R + , 

(dQt = -n m £ dt + (Sfy / 2 (J 2 - Ti)vy 2 dW t , 

with initial value (Sl, yo \ Q < ' y °' > ) = ((ui e ft,y 0 ), (1 2 — II)y 0 ) G R x R 2 , where I 2 denotes the 
2 -dimensional unit matrix and II := w r ight w irft> since we have the correspondences 

s t l “ 0> = + tm,), = M - Slight 

M (».) = Q (m) + 

see the proof of Ispany and Pap [T2J Theorem 3.1]. By Remark 12.21 S/ may be replaced 
by St for all t G R+ in the first equation of (15.41) provided that (ui e f t ,y 0 ) G R+, hence 


23 

















(it left , A it + tm E ) + may be replaced by (ui e f t , Ai t + tm £ ) for all t e M + in (15.31) . Thus the 
SDE (15.2p has a pathwise unique strong solution with initial value Zq = 0, and we have 


t e 


By the method of the proof of X^ X in Theorem 3.1 in Barczy et al. applying 
Lemma 1C.21 one can easily derive 



Alt' 


Jo (wieft, A4 S + sm £ ) l t 2 V ^ 2 dW, s 

^t = 

M 

= 

So (uieft, Ms + sm £ ) dA4 s 




^1*1^2jp]— Jo ('“left, A4 S + sra £ ) V 4 dW s J 


(5.5) 

where 


" x (ny 

V ^ 

X 

z {n) 


z 


xi n) := n^X 


\nt\ i 


as n —> oo, 


■ (^leftj A^t T tlTl £ )u v ight) ( £ 


H", 


n e N. 


More precisely, using that 


X k = y>* \Mj + m £ ), k e N, 

3 =1 


we have 


X (n) 

z (n) 


= MZ [n) ), ne N, 


where the mapping ip n : D(M+, (M 2 ) 3 ) —y D(K+, (M 2 ) 4 ) is given by 

- E L»<j -i (/l (i) - h (t 1 ) + 


ifnifl, h, fs)(t) ■ = 


flif) 

hit) 

hit) 


for fi, f 2 , f 3 G D(M+, M 2 ), t G M+, 77, G N. Further, we have 

= ^(Z), 

where the mapping ^ : D(R + , (M 2 ) 3 ) —* D(M + , (M 2 ) 4 ) is given by 


AT 

2 


f/’ih,h,h)(t) ■= 


('“'left, flit ) T tm e ) U r jght 

flit) 

hit) 

hit) 
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for /i ,/ 2 ,/3 £ D(R + ,M 2 ) and t £ R+. By page 603 in Barczy et al. [3], the mappings - 0 n , 
n £ N, and -0 are measurable (the latter one is continuous too), since the coordinate functions 
are measurable. Using page 604 in Barczy et al. [4], we obtain that the set 


C:={f£ C(R+, (R 2 ) 3 ) : /(0) = 06 (R 2 ) 3 } 


has the properties C C with C £ £>(D(R + , (R 2 ) 3 )) and P(Z £ C) = 1, where 

is defined in Appendix O Hence, by (15.ip and Lemma 1C.21 we have 


x ( n) 

z (n) 


Mz [n) ) 



X 

z 


as n —> oo, 


as desired. 


Next, similarly to the proof of (IB.51) . by Lemma 1C.31 convergence (15.5j) with Uk-i = 
(itieft, X k _i) and Lemma [B.21 implies 


n 


E 


[ n-*Ul_ J 1 


fo(Uleit,X t ) 2 dt 

™- 2 n 2 -l 

V 

<y ‘T 

n~ 2 M k U k -i 



n-WMkVk-!- 


L (l-A2)i/2 Jo dKV iJ 


as n —^ oo. 


This limiting random vector can be written in the form as given in Theorem 14.11 since 
(uieft, X t ) = y t for all t £ R+. 

Proof of Theorem 15.11 In order to show convergence Z^ Z , we apply Theorem ID. II 
with the special choices U. := Z , := Z k l \ n,k £ N, (Jy n) )fc G z + := (J r k)kez+ and 

the function 7 which is defined in Theorem 15.11 Note that the discussion after Theorem 
15.11 shows that the SDE (I5.2[) admits a unique strong solution (Z^) t( z^ + for all initial values 
Zq — z £ (R 2 ) 3 . 

Now we show that conditions (i) and (ii) of Theorem ID.II hold. The conditional variance 
has the form 


Var (Z™ | -A,-,) = 


the form 


n 2 

3 

l 

CO 

£ 

n-^V^ 



1 

CO 

1 


rT 1 ! 2 U k _]V k _\ 



-W2 Vt _ 

1 n~ 7 / 2 Uk-iV k -i 

n~ 3 V k 2 _ 1 



v Ml 

■= Var(M fc 

a), and y(s, Z 



+ sm e ) 2 

0 




+ sm £ ) 3 

0 




0 


0 
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for s G R+, where we used that (ui e f t , Ai^ + sm £ ) + = (t*i e ft, Ai^ + sm £ ), s G R+, n G N. 
Indeed, by (14. ip . we get 


(«ie£t, Mj, n) + sm £ ) = - yVtiieft, - m £ ) + (n left , sm £ ) 

k =1 


(5.6) 


fnsj 


n 


Z< wi eft?-^4 k— i Wle) 777-g:) 


fc=l 


= -('Uieft,X| ns j) + —-^-(w le ft, m £ ) = -U\ns\ + —-^L(wieft,m e ) G R+ 

n n n n 

for s G R+, n G N, since = n^ ft implies (ui eft ,m^X k ^i) = uJ eft m^X k _i = 

^left-^fc —1 = ("“left, -Xfc-l)- 

In order to check condition (i) of Theorem ID. 11 we need to prove that for each T > 0, 


(5.7) 

(5.8) 

(5.9) 

(5.10) 

(5.11) 

(5.12) 


sup 

te[o,T] 


sup 

*e[o,T] 


sup 

ie[0,T] 


n 

iMl 


Z Vm* ~ f ( nieft ’ • M i n) + sm z) v i ds 

k =i 7o 

-4 Z U k~± V M k - [ (Wleft, M^ } + sm £ ) 2 Vt ds 
n , ./o 


0, 


fc=l 

[ntj 


4 Z ^fc-i Vm* - [ (wieft, + sm £ } 3 ds 

n fc =i 


0, 


0, 


sup 

te[o,T] 


[ntj 




EU-Wm, - 


(V^left, U]e|)) 


fc=l 


sup 

te[o,T] 


1 


1-A 2 

iMl 


(nieft, Ai ( s n) + sm £ ) 2 Vf: ds 


rv 


E u-iv M> 


sup 

te[o,T] 


5/2 

fc=l 

[ntj 


0, 


n 


7/2 


Z! Uk-iVk-i VM fc 


fc=i 


0, 


as n —)■ oo. 

First we show (15 . 7f) . By (15.6p . 


[nt J — 1 


r. . . (n) . , 1 L v^\ r nt - [nt\ [nt\ + (nt -\nt\) 2 

/ (n left , Ali n) + sm £ ) ds = — > U k + - -— -£7 LntJ + -- — ( U]eft , m £ ). 

^/q 77/ 72 Z77/ 


A:=l 


Using Lemma [4.11 we have Vw k = U k _{V^ + V k _{V $ + \4, thus, in order to show (15.7p . it 
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suffices to prove 


Y nT \ 


(5.13) 

(5.14) 


n 


-2 


y]\Vk\ — y 0, n 2 sup U\nt] — y 0, 

te[o,T] 


k =1 


n 2 sup [|_ntj + (nt — l/^J) 2 ] ““t 0 
te[o,T] 


as n —y oo. Using (lA.6j) with (£,i,j) = (2,0,1) and (1A.7j) with (. £,i,j ) = (2,1,0), we have 
(15.131) . Clearly, (15.14ft follows from |nt — [nt\ \ < 1, neN, t e M + , thus we conclude (15.7ft . 

Next we turn to prove (15.81) . By (j5.61) . 

[nt J — 1 [ntj — 1 


/ 1 x—-v 1 L __L\ 

/ (itieft, + sm £ ) 2 ds = — y U k + —(u Mt ,m e ) y U k + 

70 n fc =i n k =i 


nt - iMl ^2 


n J 


[ntj 


(nt-|_^tj) 2 L ni J + ( nt ~ [nt\) 3 2 


n J 


3n 3 


Using Lemma fA.il we obtain 
(5.15) 


[nt\ [ntj [ntj [ntj 

u k - 1 v Mk = y ul_ x % + y u k _ x v k _ x v^ + ^ u k _ k v e . 

k= 1 &=1 /c=l /c=l 


Thus, in order to show (15.81) . it suffices to prove 


Y nT \ 


(5.16) 

(5.17) 


n 


-3 


V; u k v k \ A o, 


n 


-3 


k =1 


V'^^O, n 3/2 sup U \_ nt j -A- 0, 

fc =i 


n 3 sup [|_ntj + (nt — |_ntj) 3 ] —y 0 

te[o,T] 


as n —y oo. By (1A.6[) with (£,i,j) = (2,1,1) and ( £,i,j ) = (2,1,0), and by (1A.13|) . we have 
(15.161) . Clearly, (15.17ft follows from |nt — \ nt\ \ < 1, n E N, t e M + , thus we conclude (15.8ft . 

Now we turn to check (15.9ft . Again by (15.61) . we have 

t ^ \nt\-i g [nt\-i ^ bAM 

/ (wieft, + sm e ) 3 ds = — y Ul + — {u leit ,m £ ) V U fc 2 + — (u left , m e ) 2 V U k 

J o 77/ Z77/ 77/ 


k=l 

nt — |_ntj 
n 4 


fc=i 

3 3(nt- M) 2 , . _ y TT 2 


k =1 


^|n*J + 


2n 4 
\2 


■(u Mt ,m e )U lnt j 


(nt - |nt _|) 3 x2 tt l nt \ + _ L ni J ) 4 / \3 

--^—— (w lef t, m e ) 2 C/ Lnt j + ^rn e ) 3 


n^ 


4n 4 


Using Lemma fA.il we obtain 
(5.18) 


[nt\ [nt J [rcij [ n ^\ 

v 1/L.Fm, = V t/y, y + V A + V t/|_, v«, 

fc=l fc=l fc=l fc=l 
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Thus, in order to show (15.91) . it suffices to prove 

LnTJ 

%0, 


(5.19) 

(5.20) 

(5.21) 


n 


-4 


E 


n 


k =1 
LnTJ 


LnTJ 

- E u l 

k =1 


0, 


n 


-4 


V] £4 —► 0, n 4/3 sup C/ LntJ —* 0, 

te[o,T] 


k =1 


n 4 sup [|_ntj + (nt — [nt\ ) 4 ] —» 0 
te[o,r] 


as n ->• oo. By ( fX6|) with (£, i, j) = (4, 2,1), (£, i, j) = (4, 2, 0), and (£, i, j) = (2,1, 0), 
and by (IA.13D . we have (15.191) and (I5.20I) . Clearly, (j5.21j) follows again from j nt — \nt\ | E 1, 
n G N, f G M + , thus we conclude (15.91) . 

Next we turn to prove (15.101) . First we show that 


(5.22) 


n 3 sup 

ie[0,T] 


IMI /TT \ L nt \ 

E n 2 -, - (v CET rfl) E 


fe=i 


k =1 


0 


as n oo for all T > 0. Using Lemma fA.il we obtain 
(5.23) 

Using (1A.6D with — ( 6,0,3) and (£, i, j) = (4, 0, 2), we have 

LnTJ 

• 0, n~ 3 0 as n —* oo, 


[nt] [nt] [ntj |_n£j 

E u 2 -iVm 4 = e +e h-ih + e uhn. 

fc=l /c=l k =1 


n 


LnTJ 

- 3 EW 

k =1 


fc=l 


hence (I5.22[) will follow from 
(5.24) 


n 3 sup 
te[o,T\ 


\nt\ \nt\ 

E rr t/2 V^nieft, Vleft/ TT 2 

-7ETT2— 


fe=i 


fc=i 


0 as n —)■ oo 


for all T > 0. The aim of the following discussion is to decompose Z][=i £4- iV / ?_ 1 as a sum 
of a martingale and some other terms. Using recursions (14.7f) . (14. 4 p and formulas (lA.lj) and 
(IA.2p . we obtain 

E(£4_iV)?_i | -Ffc- 2 ) = E^(Ufc_2 + (wieft, Mk-1 + yn e))(^f4_2 + (theft) ^k-1 + f^e)) Fk- 2 ] 

= A 2 [/fc_2Vfc 2 _ 2 + < t E(iVf k-lM [ 7 - fc _ 2 )Wleft Ufc_2 

+ constant + linear combination of £ 4 _ 2 14 _ 2 , 4fc 2 _ 2 , C4_ 2 and 14_2 
= \ 2 U k - 2 Vk_ 2 + (V^Uieft, Uieft) f/fc_ 2 + constant 


+ linear combination of Uk- 2 Vk- 2 , V 2 _ 2 , Uk -2 and 14 _ 2 - 













































Thus 


[nt J \nt J L n ^J 

E = E l u *-i v k-i - mt-ivh i ^-2)] + E E (^-iU 2 -, 1 * 


k =1 


k=2 


k=2 


[ntj 


LntJ 


fc-2j 


[ntj 


[C/ fc _iVf_i - E(f/ fc „ 1 \4 2 _ 1 1 T k _ 2 )] +X 2 J2 u k- 2 Vk -2 + (V^ieft, v Mt ) J2 u > 


2 

k—2 


k=2 


k=2 


k =2 


[ntj [ntj [ntj [nt 

+ 0(n) + linear combination of ^^74_2l4_2, ^^V). 2 _ 2 , Uk -2 and Vfc- 2 - 

k=2 k=2 k=2 k=2 


Consequently, 


[ntj 

£f4-iU-i 


1 


nj 


1 _ ,2 E [^*-1^-1 - E(t/*-,V?_i I F, 

fc=l k=2 


k—2 


(left, V left) \ ' tt 2 a tt t t2 , \ 

H Y~\ 2 -E f/ fc-2 _ J _ + °( n ) 


L n d 


A 2 


k=2 


+ linear combination of ^^t 4 _ 2 l 4 _ 2 , C fc 2 _ 2 , ^^Uk -2 and 14 


- 2 - 


k=2 


k=2 


Using (1A.8I) with (£, i, j) — (8,1, 2) we have 


n 3 sup 
te[o,r] 


[ntj 




k=2 


Thus, in order to show (15.241) . it suffices to prove 

LnTJ 

(5.25) n~ 3 Y, \UkV k \-^Q, 


n 


k =1 
LnTJ 


k—2 


LnTJ 

- : ’En 2 

k=\ 


k=2 


0 as n —> 00 . 


k =2 


0, 


LnTJ 


(5.26) 

(5.27) 




,-3 


n “ > u k —► 0, 

k=1 


n 


-3 


E ini ^ 0, 


-3 


n - sup U\nt\V Vnt < —> 0, 
te[o,T] 


fc=i 

n _3/2 sup U\n t \ 0 
te[o,T] 


as n —> 00 . Using (1A.6I) with (£,i,j) = (2,1,1); ( £,i,j ) = (4,0,2); (£,i,j) = (2,1,0), and 
(£,i,j) = (2,0,1), we have (I5.25jl and (I5.26p . By (1A.7|) with (£,i : j) = (4,1,2), and by (1A.13|) . 
we have (I5.27p . Thus we conclude (15.241) . and hence (I5.22p . By Lemma [A. 1 1 and (IA.6P with 
= ( 2,1,1) and (£, i, j) = (2,1, 0), we get 


(5.28) 


n 3 sup 

te[o,T] 


[ntj [rcij 

k =1 fc=l 
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as n —y oo for all T > 0. As a last step, using (j5.8f) . we obtain (I5.10j) . 

For (15.lip , consider 

[ nt J [nt] [nt] [ntj 

(5.29) E bfc-i — E +£ u 2 -iU+£ u-iU, 

fc=l fc=l /c=l /c=l 

where we used Lemma IA.ll Using (1A.6P with ( £,i,j ) = (4,0,2), and ( £,i,j ) = (2,0,1), we 
have 


LnTJ 

,— 5/2 t ^2 


LnTJ 

n V)? 0, n _5//2 1141 ——> 0 as n —> 00 , 

k=1 k=1 

hence (15.1111 follows from Lemma [B.31 

Convergence (j5.12jl can be handled in the same way as (15.111) . For completeness we present 
all of the details. By Lemma IA.11 we have 

[nt] |_n£j [nt] [ntj 

(5.30) E £4_il EiFM fc — E ul 1 U- 1 U + 5] + V imm. w 

/c=l /c=l k=1 /c=l 

Using (1A.6P with = (4,1,2), and (£,i,j) = (2,1,1), we have 

n -7 /2 U^V 2 ^ A 0, n" 7/2 J2 A0 as n 00 , 


fc=i 


fc=i 


hence (15.121) will follow from 


(5.31) 


n 7//2 sup 
te[o,T] 


|nfj 

E^-iU-i 

fc=l 


0 as n —> 00 . 


The aim of the following discussion is to decompose Y^k=\ ^k- i^4-i as a sum of a martingale 
and some other terms. Using recursions (14.Tj) , (j4.4f) and Lemma [A. 11 we obtain 

E(U 2 _i\4_ 1 I J4_ 2 ) = e((*7*_ 2 + (wieft, Mk-\ + m e )) 2 (\Vk -2 + (fieft, Mk-i + m e )) 


= XU 2 k _ 2 V k -2 + constant + linear combination of t4_ 2 , 14_ 2 , U%_ 2 , V' fc 2 _ 2 and £ 4 _ 2 14 _ 2 . 


Thus 


[ntj [ n Al L n ^J 

vLiVi-i = E K-1U-1 - mhVi-i I ^-2)] + E E Wl- 1U-1 1 ^ 

fc=l fc=2 fc=2 


fc—2 i 


1 77. /. | [ntj 

E K-.u-i - E(c/y ,14-. 1 ^- 2 )] + a ^ c/y 2 vi _2 + o< 


n 


k =2 


k=2 


[nt] [ nt] | ntj [ntj ntj 

+ linear combination of ^C4_ 2 , ^ 14 - 2 , ^ U 2 _ 2 , ^ 14 2 _ 2 and ^ U fc _ 2 Vfc- 2 - 

/c=l /c=l /c=l /c=l fc=l 
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Consequently 


[nt\ 


iMl 


V f/L. 14-1 = — E H-iVk-i - mhv k - t I 2 


fc=l 


k=2 


1-A 




[ntj [ntj [ntj |_nij L 77 -^! 

+ 0(n) + linear combination of E U k -2, E U fc -2, Y. u i -2) E 14 2 _ 2 and £ U k _ 2 Vk- 2 • 

/c=l /c=l /c=l /c=l /c=l 

Using (IA.8D with (£,i,j) = (8, 2,1) we have 


n 7/2 sup 
te[o,T] 


Ml 


E K-lH-l - WLlVk-! |^-2 


fc =2 


0 as n-^oo. 


Thus, in order to show (15.311) . it suffices to prove 


LnTJ 


LnTJ 


LnTJ 


(5.32) 


n 


-7/2 


££4^0, n- 7 / 2 £f/ 2 44o, n- 7 / 2 £|U fc |Ao, 


fc=1 


fc=l 


fc=l 


LnTJ IXCI 

(5.33) n" 7/2 £ U fc 2 A 0, n~ 7/2 £ \U k V k \ A 0, 

k =1 k =1 

as n —> oo. Here 


n 7/2 sup |££jU Lri q| 
te[o,T] 

), thus we conclude (15.121) . 


Finally, we check condition (ii) of Theorem ID. 11 i.e., the conditional Lindeberg condition 


LnTJ 


(5.34) 


E E (n z i n) ii 2 i 


k =1 


{l|z£ n) ||>0} 


J^k-l) 


0 for all 6 > 0 and T > 0. 


We have E (||Z^, n) || 2 l {||z M ||>6)} | Fk-i) ^ 9~ 2 E (||z [, n) || 4 | J^k-i) and 


r(ra) 11 4 


^ 3 (n- 4 + n~ 8 U^_ 1 + n-V 4 .,) ||M fc _!| 


Hence 

L*»rj 

E (||z[. n ' ) || 2 l^|| Z (n)|| >6) j) —» 0 as n —>■ oo for all 9 > 0 and T > 0, 

fc=i 

since E(||M fc || 4 ) = 0(fc 2 ), EdlM^ 4 ^) ^ ^E(||M fc || 8 ) E(f/ fc 8 _ 1 ) = 0(fc 6 ) and 

E(|| Mk^V^) ^ y / E(||M fc || 8 )E(U fc 8 _i) = 0(/c 4 ) by Corollary M This yields (1041) . □ 

We call the attention to the fact that our eighth order moment conditions E(||^ 111 || 8 ) < oo, 
E(||£ii 2 || 8 ) < oo and E(|||| 8 ) < oo are used for applying Corollary IA.61 


31 





























6 


Proof of Theorem 


14 71 


The first convergence in Theorem 14.21 follows from Lemma IB.51 

For the second convergence in Theorem 14.21 consider the sequence of stochastic processes 


~Mf 

[nt\ 



n _1 A4" fc 

A/t> 

:=E Z 1”’ 

with 

Zf := 

n~ 2 M k Uk-i 

'pfi n ) 

k= 1 



n~ l M k V k -1 


for t G M + and k,n E N. Theorem 14.21 follows from Lemma IB.41 and the following theorem 
(this will be explained after Theorem 16.Tj) . 


6.1 Theorem. Suppose that the assumptions of Theorem \f.2\ hold. If (V^vieft, vieft) = 0 then 
(6.1) Z^ —>■ Z as n —>■ oo, 


where the process (Z t )t£ r + with values in M 2 x (M 2 ) 3 is the unique strong solution of the 
SDE 


( 6 . 2 ) 


dZ t 


l(t,Z t ) 


d W t 
d W t 


t E K-|_, 


with initial value Z Q = 0, where (W t )tm + and (W t ) teK+ are independent 2-dimensional 
standard Wiener processes, and 7 : M + x (M 2 ) 3 —> (M 2x2 ) 3x2 i s defined by 


l(t, x) 


((u Mt ,x 1 + tm E ) + y/ 2 

((theft, *1 + tm £ ) + f/ 2 

(vi eft’ m d.(( Wleft) Xl + trn ^ + y/2 


1—A 


0 

0 


(Vj^left^left ) 1/2 

(l-A 2 )!/2 


((u leit ,x 1 + tm £ ) + ) l/2 



for t G M + and x = (x 1 ,x 2 ,x 3 ) G (M 2 ) 3 . 


As in the case of Theorem 14.11 the SDE (|6.2[) has a unique strong solution with initial value 
Zq = 0 , for which we have 



A i t ' 


,f>.! /2 F c l/2 dW. 5 

z t = 

M 

= 

ftysdMs 


v t 


£ 34 1/2 vl' 2 dw, + {VeV ^ti 1/2 £ yl' 2 vf 2 d>v s 


One can again easily derive 


(6.3) 



V ^ 

X 

z (n) 


z 


as n —> 00 , 
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where 


'Xf (?1') —1 -\7~ 

^ [nt]’> 


Xt • ('^'lefto A / 'lt H - s') bright 5 ^ ^ ®H-? 77/ G 1^. 

Next, similarly to the proof of (IB.5|h by Lemma IC.31 convergence (I6.3j) and Lemma [B.4I imply 


E 

k =1 


[ n~ 3 U 2 _ 1 1 


fo (uieft, Xt) 2 d£ 



(«left,m e > 2 , (Ve«ieft,wieft) 

(1—A) 2 1 1—A 2 

n v k- i 

V 

n~ 2 M k U k _i 


Jo 1 Ai dM, 

n- x l 2 M k V k _ x _ 


_ Ml + (yyyyf'* f‘ j/, 1/2 y 1/2 dw t 


as n —> 00 . 


The limiting random vector can be written in the form as given in Theorem 14.21 since 
(uieft, X t ) =y t for all t G R+. 

Proof of Theorem 16.11 Similar to the proof of Theorem 15.11 The conditional variance has 
the form 

n~ 2 V k _ i 

,-3; 


VarfZf^M) = 


n 2 

n 3 f/ fc _i 

n~ 3 U k -i 


n~ 2 14-i 

3 

] 

CO 

1 


= Var (JWfc . 


,-2t/2 




Mk 


the form 


(wieft, + sm E ) 

(u left ,M^ n) + sm E ) 2 


(wieft, M^ n) + sm e ) 2 
(wieft, M^ n) + sm £ ) 3 


(v le{t ,m £ ) 
1—A 


(tiieft, Ali n) + sm £ ) 


^^(u^M^ + srn,) 2 
Al^ n) + sm £ ) <”ieft.^s) ( nieft; + sm e ) 2 M(u le{tl M^ + sm £ ) 




for s G M+. In order to check condition (i) of Theorem ID. 11 we need to prove only that for 
each T > 0, 


(6.4) 

(6.5) 

( 6 . 6 ) 


sup 

te[o,T] 


^ M ft 

— T Vl_ x V Mk - M / (uieft, A< n) + sm £ )y ? ds 

n fc =i 70 


0, 


sup 

*6[0,T] 


sup 

te[o,T] 


[ntj 


\ v k-i y M k ~ (u Mt , M { J l) + sm £ )V.\ ds 


n 


k= 1 
[nt\ 


tfJ2 Uk - iVk ~ iVM k - 


1-A 

(Wleft,m e ) /'* 


0, 


k =1 


1-A 


(nieft, M { s n) + sm e ) 2 V(. ds 


as n —> oo, since the rest, namely, (15.7p . (15.8p and (15.9p . have already been proved. 
We turn to prove (16.5p . First we show that 


(6.7) 


n 2 sup 
te[o,T] 


\nt\ . , |n*J 


k =1 


fc=l 


0 
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as n —> oo for all T > 0. We use the decomposition (15.291) . Using (1A.9|) with (£,i,j) = (4, 0, 2) 
and (£,i,j) = (2,0,1), we have 


LnTJ | nT\ 

n~ 2 V 2 0, n~ 2 |Vfc| —% 0 as n —> oo, 

k= 1 k= 1 

hence (16.71) will follow from 


( 6 , 8 ) 


n 2 sup 


te[o,T] 


\nt\ L nt\ 

£ £ U, 


k -1 


k =1 


k =1 


as n —)■ oo 


for all T > 0. The aim of the following discussion is to decompose ^!t=i £4-i^4-i as a sum 
of a martingale and some other terms. Using recursions (14.41) . (14.10|) and formula (1A.1D . we 
obtain 


| J~k- 2 ) — E((f/ fc _2 + (wieft, Mk~ 1 + rn e ))(\Vk-2 + (fieft) £fc-i)) 

= \Uk- 2 Vk -2 + (theft, m £ )U k - 2 + constant + constant x 14 _ 2 . 


Thus 


|_nij |n*J |_nfj 

E = E [Ufc_il4_i — E(f4_i14_i | ^-fe- 2 )] + E([4-iVfc-i I W/ 

fc=l fc=2 fc=2 

[ntj L n ^J 

= - E(C 4 _ 1 14 _ 1 I J-fc- 2 )] + A ^ f/ fc _ 2 W _2 


fc—2 J 


fc =2 


k=2 


\nl,\ |_n/,J 

+ (u left , ra e ) ^ f/ fc _ 2 + O(n) + constant x ^ U fc _ 2 . 

fc =2 fc =2 


Consequently, 


iMl 


iMl 


X) ^ [Uk-M-t - E (17*-^-! I r k - 2 )\ + 


k =1 


k=2 


(uieft, m e ) 

1-A 


LntJ 

E^ 

k =2 


-2 


[ntj 


1-A 


U\nt\ — 1 Uj_! + O(n) + constantx ^ 14 _ 2 . 


k=2 


Using (lA.lip with (£,i,j) = (4,1,1) we have 


n 2 sup 
te[o,T] 


[ntj 


[Uk-iVk-i — E(f/fc_iVfc_i | Afc_2 


k=2 


0 as n —> 00 . 
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Thus, in order to show (16.81) . it suffices to prove 


\nT\ 

(6.9) n- 2 V|T4| -A- 0, n~ 2 sup U\nt\V\_ nt \ -A-0, rU 2 sup U\n t \ -^4 0 

k=1 te[o,T] te[o,T] 

as n —y oo. By (1A.9I) with (£,i,j) = (2,0,1), and by (1A.10I) with (£,i,j) = (2,1,1) and 
(. £,i,j ) = (2,1,0), we have (16.9|) . Thus we conclude (j6.8j) . and hence (16.71) . By Lemma IA.1I 
and (IA.9[) with (£,i,j) = (2,1,1) and ( £,i,j) = (2,1,0), we get 


( 6 . 10 ) 


n 2 sup 
te[o,T] 


\nt\ 


k= 1 


\nt\ 


k =1 



0 


as n —> oo for all T > 0. As a last step, using (j5.7[) and (16.71) . we obtain (16.51) . 
Next we turn to prove (16.41) . First we show that 




[ntj 

[ntj 

( 6 . 11 ) 

n 2 sup 

E'T-i^.- 



i€[0,T] 

fc=l 

fc=i 


as n —> oo for all T > 0. We use the decomposition (15.231) . Using (IA.9D with (£, i,j) = (6, 0, 3) 
and (£, i, j) = (4, 0, 2), we have 


V nT \ 

n ~ 2 E 

k=1 


0, 


LnTj 

-- 2 E 4 2 

k =1 


0 as n —> oo, 


hence (16.111) will follow from 


( 6 . 12 ) 


n 2 sup 
te[o,T] 


\nt\ 


\nt\ 


E^-iU-.-^e^-i 


k =1 


fc=l 


0 as n->oo 


for all T > 0. The aim of the following discussion is to decompose Y^k=\ Uk-i^k-i as a sum 
of a martingale and some other terms. Using recursions (14.41) . (14.101) and formula (1A.1I) . we 
obtain 


E(C4_ \V k _i | J~k- 2 ) — E^(Ufc _2 + (itieft, AT fc_i + m e ))(\Vk-2 + ('I’left, £fc-i)) 


Tfe_2 


— A 2 t/fe_ 2 bfc -2 + 2A(ui eft , m E )f/fc_ 2 Vfc _2 + E((n left , e^-i) 2 ) £4_ 2 


+ constant + constant x 14 _ 2 . 
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Thus 


[ nt\ [ntj [ntj 

V t/nU-, = v [(/»_,v£i - | Ji_ 2 )] + V E(t/nU 2 -, I ^-2) 

/c=l /c=2 /c=2 

[ntj [ntj [ntj 

= [C/fe- 1 ^ 2 -! - HUk-iVl, I -F fc _ 2 )] + a 2 ^ £4_ 2 U fe 2 _ 2 + 2A(v laft , m £ ) ^ f4_ 2 U fe _ 2 

/c=2 /c=2 k =2 


[ntj [ntj 

+ E((vieft, £fc-i) 2 ) £ 4-2 + 0(n) + constant x U fc _ 2 . 

k =2 fc=2 


Consequently, 


[ntj 


[ntj 


V c/i-iU-i = E [ft-iU -1 - I ^-2)] + 


k=\ 


k =2 


2A(n left ,m e ) 

1-A 2 


iMl 


Y,U k - 2 V k -2 


k =2 


E((ni eft , s fc _i) 2 ) ^4 A 2 2 ^ ^ \4 T . 

- 2_Uk- 2 - _ xa ^MJ-i^Lntj-! + °( n ) + constant x ^ ^4-2- 


1-A 2 


k =2 


k=2 


Using (lA.lip with (£,i,j) = (8,1,2) we have 


n 2 sup 
te[o,T] 


\nt\ 


E [Uk-iVl 1 - E({4-,U-i l-U-2 


k=2 


0 as n-^oo. 


By (1A.9P with = (2,0,1), and by (lA.lOjl with ( £,i,j) = (4,1,2), we obtain 

L nTJ 

-2 


(6.13) 


n 


-2 




fc=i 


n “ sup U Lnt jU LntJ —» 0 
te[o,T] 


as n —y 00 , hence 


n 2 sup 
te[o,T] 


[nt\ 

E 

k =1 


2A(uie ft , m E ) 
1-A 2 


[ntj 


E ^-2^-2 


k=2 


E((Uleft, S k -l) ) 

1- A 2 


2\ M 


E ^-2 


k=2 


as n —* 00 for all T > 0. Thus, taking into account (16.81) . we conclude (16.121) . and hence 
(16. lip , since 

(v Mt ,m E )2\(v Mt ,m E ) E((n left , £ k -i) 2 ) _ (n left , m E ) 2 «ieft) 

1 - A 1 - A 2 + 1 - A 2 (1 - A) 2 + 1 - A 2 ' 

As a last step, using (I6.10p and (15.71) . we obtain (16.4p . 

Finally we turn to prove (16.6( . First we show that 


(6.14) 


n 3 sup 


te[o,T] 


[nt\ 

Y,Uk-iVk-iV Mk 

k =1 


(uieft,m e ) 

1-A 




k =1 



0 


36 










































as n —> oo for all T > 0. We use the decomposition (15.301) . Using (1A.9|) with ( £,i,j ) = (4,1, 2) 
and ( £,i,j ) = (2,1,1), we have 

[nT\ L nT\ 


n 


-3 


k =i 


X) UkV k 0, n ~ 3 52 U k\Vk\ A 0 as n ^ oo, 

k =i 

hence (j6.14[) will follow from 
(6.15) 


n 3 sup 
te[o,T] 


|ntj , . |n*J 

Y^rr2 T / ( v left) m e) rr 2 

2^ U k-l V k-l - _ x 2^ U k-1 


k =1 


fc=l 


0 as n —>• oo 


for all T > 0. The aim of the following discussion is to decompose ^i=i as a sum 

of a martingale and some other terms. Using recursions (14.41) . (14.10)1 and formula flA.ll) . we 
obtain 

•Fk—i 


E(U^_ 1 lfc_1 1 J-k-2) — E^(Ufc_2 + (uieft, + rn e )) 2 (A14_2 + (uieft, £fc-i)) 

= \Ul_ 2 V k - 2 + (vieft, m e )Ul_ 2 + constant 
+ linear combinations of U k - 2 Vk~ 2 , C 4-2 and 14 _ 2 - 


Thus 


[ntj [ntj |n*J 

v f/tiU-i = X! K- 1 U -1 - 1 ^.j)]+v 1 


k—2) 


k =1 


k=2 


k=2 


|n/.J |ntj |n/.J 

E K-.Vi-i - E(t/tiU-i I Jt-2)] + A ]T C/L2U-2 + (»wt, m«> £ C/L2 

fc =2 fc =2 


k=2 


\nl\ \nt\ n1.\ 

+ O(n) + linear combinations of E U k -2Vk-2, 52 ^ k ~ 2 an d 52 ^- 2 - 


k=2 


k=2 


k=2 


Consequently, 


|ntj 

fc=l 

Lntj 

= ! _ A E K-iU-' 

k =2 


/ \ imi 

+ 2 

1 - A ^ 

k=2 


~k -2 


E ^-2 - 


[ntj [ntj [ntj 

+ O(n) + linear combinations of £ 4 - 2 ^ 4 - 2 , 52^ k ~ 2 an< ^ 52^ k ~ 2 ' 

k=2 k =2 /c=2 


Using (1A.11I) with (£,i,j) = (8,2,1) we have 


n 3 sup 
te[o,T] 


LntJ 


E K- 1 U -1 - E(t/|_ 1 vi - 1 1 Ji_ 2 


k=2 


0 as n —>■ 00 . 
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Thus, in order to show (16.151) . it suffices to prove 


(6.16) 


(6.17) 


n 


\nT\ 

~ 3 J2 Uk \ Vk 

k =1 


0, 


\nT\ 

n~ 3 J2 U k 

k =1 


0, 


n 


[nT\ 

■ 3 £wi 

k= 1 


0, n sup £7 LntJ |V L ^j| —> 0 

ie[0,T] 


as n —> oo. By (IA.9|) with (£,i,j) = (4,1,1) and ( £,i,j ) = (4,1,0) we obtain (I6.16|) . By 
(IA.9|) with ( £,i,j) = (4,0,1) and (1A.10I) with ( £,i,j) = (4,2,1), we obtain (j6.17|) . Thus 
we conclude (j6.15|) . and hence (16.141) . By Lemma I A. 1 1 and (IA.9|) with (. £,i,j) = (4,2,1) and 
(£,i, j) = (4,2,0), we get 


(6.18) 


n 3 sup 
te[o,T] 


\nt\ [nt J 

k =1 k =1 


0 


as n —> oo for all T > 0. As a last step, using (j6.14j) and (15.81) . we obtain (16.61) . 

Condition (ii) of Theorem ID.II can be checked again as in case of Theorem 15.11 □ 


7 Proof of Theorem 13.8 


By Quine and Durham [22j, the Markov chain (Xk)k&z + admits a unique stationary distribu¬ 
tion, and we have 


n / / _ Xi X2 

(7.1) r E f(x k _ u x t ) ±4 E ( / ( x, E «M,1 + E 

k =1 ^ ' j=i i=i 


n 


as n —> oo, 


for all Borel measurable functions / : M 2 x R 2 —> M with 


E 




< 00 , 


see (2.1) in Quine and Durham [22], By Quine [21], we have E(||X|| 2 ) < oo, hence 

1 U 

(7.2) E(II T ), as n oo. 

n k =1 


The aim of the following discussion is to show that the matrix E(XX ) is invertible. By 
Quine [21], we have 

OO 

E(lf) = ^mi(E(Xi)V €l +E(X 2 )^ 2 + V £ )(mJ) i + E(X)E(X T ). 

i =0 
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If E(XX ) is not invertible, then there exists u?gM 2 \{0} with w T E(lX )m = 0. But 
then E (Xi)w T V^ l w = 0, E (X 2 )w T V^ 2 w = 0 and w T V e w = 0. We have E(Ad) > 0 and 
E(X 2 ) > 0, since, by Quine [2Tj, we have E(X) = '^2°Ao rn \ rn £’ where m e A 0 and there 
exists « 6 M such that the entries of are positive. Consequently, we obtain w T V^w = 0, 
w t V^ 2 w = 0 and w T V £ w = 0, which is impossible, since at least one of the matrices , 

V 6a , V £ is invertible, hence E(XX ) has to be invertible, and we conclude 

(7.3) f-f^X^XjA ^ [E(XX T )] _1 , asn^oo. 

k =i 7 

Applying again (17.11) and using the decomposition (14.9p . 


1 

n 


fc=i 


m^X k _i - m^Xj^ 



x 2 


J,i)) + - miJ , 2 )) + (61 - E(ei)) ) X T 


3 =1 


= E 


Xi X-2 

e( - E(S W )) + + (e, - E( £l) ) 

3=1 3=1 


-T 


X )X 


= 0 


as n —> oo. Consequently, 


-~-(ra) 

m> — 




k =1 


k =1 


-1 


0 


as n —* oo, hence we obtain the strong consistency of rh^‘\ By the continuity of the function 
r, this implies the strong consistency of = r(m^ n ). 

The asymptotic normality (j3.8[) can be proved by the martingale central limit theorem. We 

) ^ \ — I 1 \ ^ rr \ ( 1 \ ^ v. vT ) 


can write 

v fc=i 7 v fc=i ' 

with Z fc := M k Xj_ v We have E(Zf 2 | X fc _i) = E(Mf 2 | .F fe _i) (Xj.Q® 2 . By the decom¬ 
position (14.91) . 

2 

(7.4) E(Mf =^AVi,E[(5 1 , m -E(^ u ))® 2 ] +E[( £i -E( £ i ))® 2 ], k elf, 




thus by (17.11) . the asymptotic covariances have the form 


fc=i 


-E E ( z f ^-i) ^ E E [«i,w - E« Wli ))® 2 ] E 

i =1 

+ E[(e 1 -E(e 1 ))^ 2 ]E [X 


XAX 


'T 


as n —> oo. 
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The aim of the following discussion is to check the conditional Lindeberg condition 


1 X A 

(7.5) -^E(||Z fc || 2 l { || Zfc || > ^ } | P fe _i) -A 0 as n-^oo for all 6 > 0. 

n k=i 

By the decomposition (14.911 . 


E(Mf | 7-fc-i) = P(X fc _ 1(1 ,X fc _ 1)2 ) 

with P = (Pi,..., Pi 6 ) : M 2 ->• M 16 , where Pi, , Pl 6 are polynomials having degree at most 
2, and their coefficients depend on the moments E[(^ 111 — E(^ l lil )® 4 ], E[(^ 1 12 — E(£ lil)2 )® 4 ], 
E[( ei -E( £l )® 4 ], V^, Vs 2 and V £ . Thus 


-j^ ll ^ ll 

k=l k =1 




k-l) — 


k =1 


n 2 6 2 


J2\\X k \\ 4 P(X k _ 1A ,X l 


k- 1,2 J 


k =1 


as n —>• oo for all 0 > 0, since, bv Lemma lA.91 E(||X fc || 4 |P(X fc _ lj i,X fc _i j2 )|) = 0(1), hence 
n -2 E(||X/ c || 4 |P(Xfc_i i i, A"fc_i i2 )|) —> 0 as n —> oo. Consequently, by the martingale 

central limit theorem, we obtain 


1 

U ^ 2 


k=1 



as n —)■ oo, 


where Z is a 2x2 random matrix having a normal distribution with zero mean and with 




2—1 


XAX 


-T 


+ E[(ei-E( £l )f 2 ]E 


X 


Using (17.31) and applying Slutsky’s lemma, we obtain (13.81) . 

The convergence (j3.12[) follows from (13.81) by the so called Delta Method with the function 
r, see, e.g., Lehmann and Romano [T8l Theorem 11.2.14], 


Appendices 

A Estimations of moments 


In the proof of Theorem 13.11 good bounds for moments of the random vectors and variables 
(M fc ) fceZ+ , (. X k ) keZ+ , (t4)fcez + and (' V k ) keZ+ are extensively used. First note that, for all 
fceN, E(AFfc | Pfc-i) = 0 and E(AT*,) = 0, since = X/, : — E(Xfc | Pt_i). 
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A.l Lemma. Let (X k ) ke % + be a 2-type Galton-Watson process with immigration and with 
Xq = 0. If E(||^ 14 || 2 ) < oo, E(||C m>2 || 2 ) < oo and E(||ei|| 2 ) < oo then 

(A.l) Var(M fc | R k .f) = X k _ hl V^ + X k . h2 V^ + V £ = U k . x % + + V e 


for all fceN, where 


If E(||* liU 
(A.2) 


3 ) < °°? E(ne lili2 

E(Mf | X k -f) = 


V/e „ ^ ^-(1-^, 

2_^\ e n bright/ a i i _ X 


i=l 
II3 


(3 + 1 -5 

) < oo and E(||e!|| 3 ) < oo then, for all fceN, 


+ AVi, 2 E[(«i,i, 2 - E(£ u , 2 )® 3 ] + E[(e, - E( £l )® 3 ]. 


Proof. Using the decomposition (I4.9p . where, for all k G N, the random vectors {£ k ,j,i — 
E(^fcj, l), £ k ,j. 2 - E(^ feJ)2 ), e fc - E(e fc ) : j eN] are independent of each other, independent of 
T k - 1 , and have zero mean vector, we conclude (IA.1D and (IA.2I) . □ 

A.2 Lemma. Let (Cfc)fceN fre independent and identically distributed random vectors with 
values in M d such that EdlCiJlO < 00 with some feN. 


(i) Then there exists Q = (Q i,..., Q d e) : M —> M“ , where Qi, ..., Q d t are polynomials 
having degree at most i — 1 such that 

E((Ci + • • • + Cn) 9 *) = N £ [E(Ci)]^ + Q(N), NeN, N>L 

(ii) If E(£ x ) = 0 then there exists R = (Ri,... , R d e) : M —> M. d *, where Ri, ..., R d t are 
polynomials having degree at most |_£/2J such that 


E((C 1 + --- + Cn)^) = R(N) : Ne N, N>L 


The coefficients of the polynomials Q and R depend on the moments E(^ il ® ■ ■ • (8) C»,)> 
h, • • •, ii £ { 1 , • • •, N}. 


Proof, (i) We have 


E((Ci + ■ • • + C«) w ) 


E 

sE{l,. 

ki+2k2~\ -h sks = £, ks^O 



CV) 


(N - h - • • • - k s X 


x Y, E(C n ®---®Cj, 
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where the set P^^\ s consists of permutations of all the multisets containing pairwise different 
elements of the set {1,...,A} with multiplicities fa,...,k s , respectively. Since 

f'N\j'N-k l \ fN-k 1 - k s _A = N(N - 1) • • • (A - fa - k 2 - k s + 1) 

\fa)\ k 2 J V fa J fa\k 2 \ ■ ■ -fa\ 

is a polynomial of the variable N having degree fa + • • • + k s fa £, there exists P = 
(Pi,..., P^) : M —>■ , where Pi, ..., P r ji are polynomials having degree at most £ such 
that E((<^ 1 + - • -PCn)^) = -P(iV). A term of degree £ can occur only in case fa + - ■ - + fa = £, 
when ki + 2 k 2 + • • • + sk s = £ implies s = 1 and k\ = £, thus the corresponding term of 
degree £ is N(N «• 1) ■ ■ ■ (N — £ + 1) [E(^ 1 )]' 8> , hence we obtain the statement. 

(ii) Using the same decomposition, we have 


»(«,+ + 


E 

se{2,.../}, k 2 ,...,k s ez + , 
2k 2 +3k3~\ -h sk s =l, k s ^0 



(V) 


(N-fa - k a - A 


ks 


Here 

fN\(N-fa\^(N-fa - fafa = N(N - 1 )...(N-fa-fa - k s + 1) 

\fa) V fa J \ fa ) k 2 \fa\ ■ ■ ■ fa\ 

is a polynomial of the variable N having degree fa + ■ ■ ■ + k s . Since 


£ — 2fa + ?>fa + • • • + sk s ^ 2(fa + fa + • • • + k s ), 

we have fa + ■ ■ ■ + fa fa £/2 yielding part (ii). □ 

A.3 Remark. In what follows, using the proof of Lemma [A.41 we give a bit more explicit form 
of the polynomial fa in part (ii) of Lemma IA.4I for the special cases £ = 1, 2, 3,4, 5, 6. 

E(Ci + • • • + Cw) = 0 

E((C 1 + -"+C N ) 02 ) = AfE(Cf). 

E((Ci + ■ " + Cat) 03 ) = N E(£f 3 ). 

E((Ci + ■ • • + Cjv) 04 ) = N E(Cf 4 ) + N{ - N 2 ~ Y, E(C 4i ® Ci, ® Cj, ® CiJ- 

(n,*2,*3,*4)6fo, i 2' 4) 

E((Ci H + Cw) 05 ) “ 7VE(Cf 5 ) + N(N — 1) £ E(C fl <8 < ia ® Ci, ® Ci„ ® Ci 5 )- 

(^15^2 5^3 A4 A5 ) ^-^0, l, l ^ 
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E((Ci + • ■ • + < N )® 8 ) 

= N E(Cf 8 ) + N(N - 1) Yl E (C„ ® Ca ® C, ® C i4 ® C is ® Ci„) 

(ilj* 2 ,i 3 M^5 5^6 ^0,1,0,\ 

+ E(Cu ® C ia ® C, 3 ® Cm ® C, 5 ® C J 

(il,» 2 ,» 3 j» 4 ,i 5 ,» 6 )GPo^'’ 2 ^ 

+ iV(iV-i)(iV-2) ^ E(c n ®C t2 ®C i3 ®C l4 ®C 5 ®C J6 )- 

(*1 ,*2,13 ,M,i 5 ,i6)eP 0 ( ^’ 6) 


□ 


Lemma IA.2I can be generalized in the following way. 

A.4 Lemma. For each i G N, let fc ) fceN i> e independent and identically distributed random 
vectors with values in R d such that EdlCi.illO < 00 with some I G N. Let j i,..., j £ G N. 

(i) T/ien t/jere exists Q = (Q i,..., where Q, Q d i are polynomials 

of I variables having degree at most I—\ such that 

E ((Ch,i d f Cji,iVi) ® ® (C^,i H L C jt ,Nt)) 

= N 1 ...N £ E(C il , 1 ) ® ■ ■ • ® E(C i£il ) + Q(N U ..., Nf) 
for N u ..., N £ G N with N x ^i, N £ ^£. 

(ii) If E(£j ltl ) = ... = E(£y <a ) = 0 then there exists R = (i?i,..., R d t) : —> where 

R\, ..., R d e are polynomials of I variables having degree at most |_£/ 2 J such that 

E ((Cji,l -I d Cj^Nx) ® ® {Cj e ,l H 1- C j e ,N e )) = R{ N 1, ■■■,Ne) 

for N 1 ,...,N t e N with N x > l, N t ^£. 

The coefficients of the polynomials Q and R depend on the moments E(^ ; - liil ® ■ ■ ■ <E> Cj e ,i e )> 
h G {1,..., iVi}, ..., ig G {1,..., Nf}. 

A.5 Lemma. Let (X k )kez + be a 2-type Galton-Watson process with immigration such that 
a, 7 G [0,1) and /3 ,7 G (0, 00 ) with a + 5 > 0 and /Ty = (1 — a)(l — 7 ) (hence it is 
critical and positively regular). Suppose A 0 = 0, and Edl^i il^) < 00 , Ed|£ x 12 \f) < 00 , 
Edledl*) < 00 with some I G N. Then E(||X fc || £ ) = 0(k e ), i.e., sup feeN k~ e E(||X fc ||^) < 00 . 

Proof. The statement is clearly equivalent with E(|P(Afc jl5 A^ 2 ) ^ Cp j£ k e , k G N, for all 
polynomials P of two variables having degree at most £, where Cp >£ depends only on P 
and I. 
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If t = 1 then (12.3ft and (12.61) imply 


k -1 

E(X fc ) = y j rn J £ rn £ 
1=0 


k 


2 — a — 5 


1-5 $ 

7 1 — a 


+ 


1 — (a + s — iy 

(2 — a — 5) 2 


1 — a —/3 
—7 1 — 5 




for all fceN, which yields the statement. 

By (J2ID, 

i »2 /„ \ 82 


(A.3) 


= | E 

3 =1 

' ^k- 1,2 

5^ ^ fc >l > 2 

1=1 


Xk-1,2 \ / ^fe-1,1 

X] + £ fc 2 + I X] ^,14 

i=i / \ 1=1 



-Xfc-1,2 

5 V £k,j ,2 
1=1 



-Xfc-1,1 \ / Hfc-1.1 \ / -Xfc- 1,1 

E «*,,,■ + E «*j,i ® ® E €«* 

1=1 / \ 1=1 / V 1=! 


'*fc-l,2 \ /^fc-1,2 \ 

51 ^, 1,1 I + ( 51 &jaJ ■ 

Since for all k e N, the random variables {£ fc ^ 1 , - 2 ) £ k '■ j G hi} are independent of each 

other and of the cr-algebra we have 


M 


, 1=1 


M 



m=A 7_ 1 , 1 


M=X k _ ltl 
N=X k _ li2 



+ E(e? 2 ) 


JV=Xfc-l, 2 


+ E 1 E«*j.i 

, 1=1 


M 


(8) E(e fc ) + E(e n ) (8) E E««. 


M=X fc _ 1 , 1 


v 


+ E ( 5 Z ^fcj ,2 
, 1=1 


, 1=1 

N 


< 8 > E(e fe ) + E(efc) < 8 > E (E« *, 1,2 


Ml-u 


N=X k _, 2 


N=X k _ i , 2 

Using part (i) of Lemma [A.41 and separating the terms having degree 2 and less than 2, we have 
E(Xf | JU) 

= X^^raf 2 + Xj?_ 12 m 02 + Xfe_i ) iXfc_i j2 (m^ 1 < 8 > m $2 + m €2 < 8 > m €l ) + Q 2 (X fc _i,i, X fc _i )2 ) 
= (^- 1 , 1 ^ + X fc _ 1>2 m^ 2 ) 02 + Q 2 (Xk-i,i,X k _ li2 ) = (m^X fc _!) 02 + Q 2 (X fe _ 1;1 ,X fe _ 1)2 ) 

= mfX®\ + Q 2 ( X fc _ni,X fc _ li2 ), 
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where Q 2 = ((? 2 ,i, <32,2, <32,3, Q24) : K 2 ->■ M 4 , and Q 2 ) i, <32,2, <32,3 and Q 2,4 are polynomials 
of two variables having degree at most 1. Hence 


In a similar way, 


E(Xf) = mfE(Xfi 1 ) + E[Q 2 {X k _ 1A ,X k _ lt2 )\. 


E(Xf) = m|'E(Xf,) + E[Q ( (X l _ M ,X l _ li2 )], 


where Qi — (Qt, i) • • • , Q^) : K 2<? , and Q t>1 , ..., <3y 2 < are polynomials of two variables 


having degree at most £ — 1 , implying 

k 


E(Xf) = ^(mf) t -JE[Q,(X J _ u ,X J _ 1 , 2 )] 


(A.4) 


3 = 1 
k 


J=1 


Let us suppose now that the statement holds for 1, ...,£ — 1. Then 

E[|Q, ii (X J -i ! i,X,_i i2 )|] ^ c Q ltU £-ik e \ fceN, i G {1,..., 2 1 }. 

Formula (12.6[) clearly implies ||(m^) lg ^|| = 0(1), i.e., sup igZ+jteN ||(m^) l8 ’^|| < 00 , hence we 
obtain the assertion for t. □ 


A. 6 Corollary. Let (Xk)k£Z+ be a 2-type Galton-Watson process with immigration such 
that a,5e[0,1) and ^,76 (0, 00 ) with a + 5 > 0 and /3y = (1 — a)(l — 7 ) (hence it is 
critical and positively regular). Suppose X 0 = 0, and Edit, nil') < oo, E(||£ 112 ||') < oo, 
E(lkill') < 00 with some £ e N. Then 

E(||X,||*) = 0(F), E(Mf) = 0(^/ 2 J), E(U l k ) = 0(k i ), E(V * j ) = 0{k j ) 

for i,j e Z + with i ^ £ and 2 j ^ £. 

If, in addition, (V^uieft,'Uieft) = 0 ; then 

= 0(1), E(Vf) = 0(1) 

for i,j e Z + with i ^ £ and 2 j ^ £. 

Proof. The first statement is just Lemma [A.51 Next we turn to prove E [M® 1 ) = 0(&3*/ 2 J). 
Using (14.91) . part (ii) of Lemma [4.41 and that the random vectors {C/ty.i _ E(^ / , j l ), -. 2 ~ 

E (^fc,y 2 )i £k - E(e fc ) : j £ N} are independent of each other, independent of T k - 1 , and have 
zero mean vector, we obtain 


E{Mf i \F k _ 1 ) = R{X k _ ltl , 


X, 


k-1,2 J 


7 
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with R = (i?i,..., R-y ,.) : M 2 —> M 2 *, where R\, ..., are polynomials of two variables 
having degree at most i/2. Hence 


E (Mf) = E (#(**_!,!, X fc _ 1)2 )). 
By Lemma lA.51 we conclude E(lVff > *) = 0 (A;L*/ 2 J). 


Lemma [A. 5 1 implies E(L/£) = E 


1 , ( 2 - 0 - 8)13 ) 


O(^). 


Next, for j G E + with 2j + we prove E(V^ 2j ') = 0(fc J ) using induction in fc. 
By the recursion 14 = (a + 5 — l)14-i + (v\ eit ,M k + m e ), k G N, we have E(14) = 
(a + 5 — 1) E(y fc _i) + (uieft, m e ), k G N, with initial value E(Vq) = 0, hence 


fc-i 

E(U fc ) = (wieft, m e ) ^(a + 5 - 1)*, fcGN, 

i=0 


which yields |E(14)| = 0(1). Indeed, for all k G N, 

fc-i 

+ 5-1)* 

i =o 

The rest of the proof of ~K(V^) = O (k j ) can be carried out as in Corollary 9.1 of Barczy et 
al. [5]. 

By (14.9p and Remark [3.41 (14 theft, theft) = 0 implies 


1 

^ 1 — \a + 8 — 1 


(theft, M k ) = (uieft, £k - E(e fc )), fcGN, 

implying E((v Mt , M k } 1 ) = E((th e ft,£i - E(ei)) 1 ) = 0(1) for i G E + with i 4 l. 

Finally, by (14.211 . we obtain 

(theft, X-k) (theft, l) + (theft, tTt. e ) + (theft, ^k E(Sfc)) (tTl^theft, X fc_i) + (theft, &k) 

Using mjv le{t = (a + 5 — 1) theft, we conclude 

(A.5) 14 = (a + 8 — l)14_i + (theft) e k), k G N. 

Thus we get a recursion 14 = (ct + 5 — 1)14— i + (theft, M k ), fcGN, for the sequence 
V k '■= V k — E(14), fcGN, and rest of the proof of E(14 2j ) = 0(1) for j G Z + with 
2 j 4 £ can be carried out again by the method Corollary 9.1 of Barczy et al. 0, applying 
E( (theft, A24)*) = 0(1) for i G Z + with i ^ l. □ 

The next corollary can be derived exactly as Corollary 9.2 of Barczy et al. [5j. 


A.7 Corollary. Let (X k ) ke z + be a 2-type Galton-Watson process with immigration with 
offspring means (a , 5) G (0, l ) 2 and = (1 — a)(l — 7 ) (hence it is critical and positively 
regular). Suppose X 0 = 0, and E(||^ 111 || £ ) < oo, E(||£ 112 || £ ) < 00 , E(||erx|| £ ) < 00 with 
some £ G N. Then 
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(i) for all i,j G Z + with max{i, j} ^ |_£/2j, and for all n > i + | + 1, we have 

n 

(A.6) | 0 as n —» oo ? 


fc=i 


(ii) for all i,j G Z + with max{i, j} ^ for all T > 0, and for all k > i + | + — 


2 1 f ’ 


we 


have 

(A.7) 


n K sup \U\ra\ v \nt\ \ —^ 0 as n^oo, 

ie[o,T] 


(iii) for all i,j G Z + with max{j, j} ^ |_7'/4J, for all T > 0, and for all n > i + | + 4, 


we /iave 
(A.8) 


n K sup 
te[o,T] 


IMJ 




k =1 


0 as n —>■ oo. 


If, in addition, (V^u left , Ui e f t ) = 0, t/jen 

(iv) for all i,j G Z + with max{i, j} ^ |_£/2J, and for all k > i + 1, we /lave 

n 

(A.9) n~ K |?7fcVfe | —0 as n —>■ oo, 


k =1 


(v) for all i,j£Z + with max{i,j} ^ £, for all T > 0, and for all K>i + ^-f-, we have 

(A.10) n~ K sup | U \ nt | Vf ni 1 1 0 as n —» oo, 

te[o,T] L J 

(vi) for all i,j G Z + with max{i, j} ^ |_^/4j, for all T > 0, and for all n > i + we 
have 


(A.ll) 


n K sup 

te[o,T] 


\nt\ 


Yj[U' k v’-mivi\T b ^)) 


k=1 


0 as n —>■ oo. 


(vii) for all j G Z + with j ^ ? for all T > 0, and for all n > we /iave 


(A.12) 


n K sup 
te[o,T] 


[ntj 




fc=l 


0 as n ^ oo. 


A.8 Remark. In the special case I = 2, i = 1, j = 0, one can improve (1A.7D . namely, one 
can show 


(A.13) 

see Barczy et ah [5j. 


n K sup U\nt\ —> 0 as n —> oo for k > 1, 

i€[0,T] 


47 










A.9 Lemma. Let (X k ) ke z + be a 2-type Galton-Watson process with immigration such that 
a, 7 G [0,1) and /3 ,7 6 (0, 00 ) with a + 5 > 0 and /Jy < (1 — a)(l — 7 ) (hence it is 
subcritical and positively regular). Suppose X 0 = 0, and E(||£ lu || £ ) < oo, E(||£ 112 ||*) < oo, 
Edlsil^) < 00 with some feN. Then E(||X fc || £ ) = 0(1), i.e., sup fcgN E(||X fc || £ ) < 00 . 

Proof. The statement is clearly equivalent with E(|P(Afc jl ,Afc j2 )|) ^ Cp^, k G N, for all 
polynomials P of two variables having degree at most £, where cp^ depends only on P 
and l. 

By m and flZED, 

k— 1 k— 1 k —1 

E(X fc ) = ym^m £ = y A^Uright uj cit m £ + y \-V light vJ eit m £ 
j =0 j=o j =0 

for all k G N, which, by |A_| ^ A+ < 1, yields ||E(Xfc)|| = 0(1), and hence E(||Xfc||) = 
0 ( 1 ). 

Let us suppose now that the statement holds for 1, 1. By flA.41) . 

k 

E (X?) = ^(m^)®'E[Q t (V_,, 1 , Xj-w)], 

3 = 1 

where Q e = (Qe,i, ■ ■ ■, Qe, 2 e ) '■ E 2 E 2< , and Q 71 , ..., Qe. 2 f - are polynomials of two variables 
having degree at most l — 1. By the induction hypothesis, 

E[|Q„(A i _i,i,A J _i, 2 )|]^c Q ^_i, fceN, i E {1,... ,2 e }. 

Formula (12.6(1 clearly implies ||(m^)®^|| = 0(A+), i.e., sup igZ+jteN A+* £ || (m|)®^|| < 00 , hence, 
by 0 < A + < 1, we obtain the assertion for t. □ 


B CLS estimators 

For each n G N, a CLS estimator of m^ based on a sample X !,..., X n can be 

obtained by minimizing the sum of squares 

n n 

Y \\X k - E(X fc | T k -i) || 2 = y \\X k - m^X k _ 1 - m e || 2 

k =1 k =1 

with respect to m^ over M 2x2 . In what follows, we use the notation x 0 := 0. For all n G N, 
we define the function Q n : (M 2 ) n x R 2x2 —* R by 

n 

Qn{x\, m's) := y \\x k - ra^zifc.! - m £ \\ 

k= 1 
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for all m ^ G M 2x2 and * 1 ,... ,x n G M 2 . By definition, for all n G N, a CLS estimator of 
is a measurable function F n : (M 2 ) n —> M 2x2 such that 

Qn (®1 j • • • j -^n(® 1 : ■ ■ ■ j *®n)) Qn(®l j • • • 5 ) 

m ^ gR 2 x 2 s 

for all X\,... ,x n G R 2 . Next we give the solutions of this extremum problem. 

B.l Lemma. For each n G N, any CLS estimator of m^ is a measurable function F n : 
(R 2 ) n —y R 2x2 for which 

(B.l) F n (X \, . . . , 3?^) H n (Xi : . . . , 33 n )(j n (a3i, . . . , 33 n ) 

on f/ie set 

{(* 1 , ... ,x n ) G (M 2 ) n : det(G n (*i,.. .,*„)) > 0}, 

where 

n n 

G n {x 1,..., * n ) := Xfc-lXfe-i, #„(*!, ■ ■ •, *n) := _ 

/c=l /c=l 


Proof of Lemma IB.11 In the proof we write 




o' /?' 

y 5' 


Fn 


f (n) f{ n Y 
J 1,1 J 1,2 

An) An) ’ 

J 2,1 J 2,2 _ 


hn,i ^ ( 


fc=l 




Tkle,i)%k— 1,1 

^e,i)^k—1,2 


i e { 1 , 2 }, 
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G n (aq,..., x n ) = G n , H n (x!,... ,x n ) = H n , and Q n (xi,... ,x n ;m^) = Q n . The quadratic 
function Q n can be written in the form 

n n 

Qn = ^Ofc,l - a'x k - 1,1 - pX k -l ,2 - m e> i) 2 + ^0fc,2 - Qxk-l.l - S'xk- 1,2 - rrie^) 2 


k=l 


E 

k =1 


k =1 


r - 

T 




r -| 

a' 


™2 

x k- 1,1 

^fc-l,l^fc-l,2 


Cl' 

P. 


_^fc-l,l^A;-l,2 

x k- 1,2 


p. 


E 

fc=i 


a 

P 


T 


(xk,\ 1,1 

(Xk,l ^£,l)^/c— 1,2 


E 

k =1 

n 

E 


1,1 

T 

a' 

1,2 


P 


+ E( Xfc ’ 


i - m S A 


k =1 


k =1 


T 




fc—1,1 ljl^fe—1,2 


l,l^fc—1,2 Xfc— 1,2 


E 

fc=i 


T r 


(Xfc,2 Tfl £ ,2)%k— 1,1 
(xfc , 2 — ra £? 2 )^- 1,2 


E 

fc=i 


a 

P 


{Xk, 2 — m e, 2 )£fc-l ,1 
(Zfc,2 — fkle,2)Xk-l,2 

- G~ l h n ,! 1 G, 


1 T 

i 

5’ 



a' 





E( Xfc ’ 


2 - "le, 2 j 


fc=l 


— G^/i^i I — h' 1 G n i h„ ) i 


T ^-y- 1 1 


- Gl 1 h, 


n, 2 


G r 


- G n l K,2 ) - /iJ 2 G n 1 /i n)2 + ||£Cfe - rn £ 

k =1 

>n 9 


We can check that the matrix G n is strictly positive definite. Indeed, EI!=i ^fc-i.i Efc=i x fc-i 2 — 
(EL^- 1 , 1 ^- 1 , 2) 2 > 0 implies EL ^- 1,1 ELi 4 - 1,2 > °. and hence, E1U 4 - 1,1 > 0 


(G- 1 )' = H n G~ , 


™2 

= 1 x fc- 

, 2 > 0. Consequently, 



1 1 

Ee Ee 

to h - 1 

1 _ 1 

— G n X,i, 

1 1 

Vim 

1 _ 1 

Gn ^n, 2 ? F'n 

'hi, i 
K,2_ 


since 


<1 

.< 2 . 


E 

k =1 


(Xfc,i ( Xfci ®e,l)^H,2 

(jXk,2 ~ fne,2)Xk-l,l (Xk,2 ~ ™e, 2 )lH,2 


^ ^ (Xk 1 H n 

k =1 


hence we obtain (IB.lIh 


□ 


For the existence of these CLS estimators in case of a critical symmetric 2-type Galton- 
Watson process, i.e., when g = 1, we need the following approximations. 


B.2 Lemma. Suppose that the assumptions of Theorem \3 . 1\ hold. For each T > 0, we have 

D 

->■ 0 as n —)■ 00 . 


n 2 sup 

te[o,T] 


iMl ,Y7 \ L nt J 

E t/2 \ * / € V left) u left/ TJ 

V k -WTW- Uk ~ 1 


k=1 


fc=l 
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Proof. In order to prove the satement, we derive a decomposition of Xli~i 4 2 as a sum °f a 
martingale and some other terms. Using recursion (14.71) . Lemma [A. II and (14. lip , we obtain 

E(U fc 2 ! -4-i) = ® [(AI4-1 + (vieft, M k + rn e )) 2 | T k - 1] 

= A 2 Vk_i + 2A(«ieft, m e )V k ^i + (vieft, m e ) 2 + E (M k M J k \ J4_i)vi eft 
= A 2 T4 2 _i + vJ eft (X k ^i,iV^ + A fc _i i2 V r ^ 2 )vief t + constant + constant x V k -i 
= X 2 Vf?_\ + vJ e{t V^Vi e { t U k -i + constant + constant x I4_i- 


Thus 


\nt\ [nt\ [ nt\ 

E U 2 = £ [n 2 - E(l? I JVi)] + £ E(U 2 1 T, 

k= 1 /c=l 


fc-lj 


ife=l 


|_n£j [ntj [ntj 

£ I 12 -. 2 - E (u 2 1 ^-i)] + a 2 e e 

/c=l k =1 


fc=l 


[ntj 


+ O(n) + constant x 14 - i • 


fc=i 


Consequently, 
L nt l 


[nt\ 


k =1 


1 


[ntj 


1-A 2 


E [U 2 - E(Vf I ^-l)] + Vleft) E U > 


fc=l 


[ntj 


fc-1 


k =1 


—+ °( n ) + constant x ^ 14 - 1 - 


1-A 2 


k =1 


Using (1A.8P with (. £,i,j) = (8,0,2) we obtain 


n 2 sup 

te[o,T] 


|ntj 

E K - E (u 2 1 ^-i 

fc=i 


0 as n —> oo. 


_____ jp 

Using (IA.7P with = (3,0,2) we obtain n~ 2 sup tg [ 0jT ] V 2 nt \ —> 0. Moreover, 

n~ 2 4l;=i 4-1 —> 0 as n —» oo follows by (IA.6[) with the choice (£,i,j) = (8,0,1). 
Consequently, we obtain the statement. □ 

B.3 Lemma. Suppose that the assumptions of Theorem \3 . 1\ hold. Then for each T > 0, 


n 5/2 sup 
te[o,T] 


\nt\ 

J2 L h-iVk-i 

k= 1 


as n —)■ oo. 
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Proof. The aim of the following discussion is to decompose Xli=l U k -\V k -\ as a sum of a 
martingale and some other terms. Using the recursions (14.71) . (14.4j) and Lemma [A. 11 we obtain 

E(f/fc_il4_i | J- k _ 2 ) = E^(T4_2 + ("Uieft, Mk~i + 7Tr e ))(A14_2 + (vi e f t , M k _i + th-e)) ^- 2 ^ 

= \Uk-2Vk-2 + (theft, m £ )U k - 2 + A (it i ef t, m e )Vk -2 + ujrftmemjtheft 
+ w T E(M A ._fMj_ 1 1 .F fc _ 2 )i; 

= \U k - 2 V k -2 + constant + linear combination of U k - 2 and 14 - 2 - 


Thus 


\nt\ \nt\ [nt\ 

J 2 u k-iVk-i = Y [Uk-iVk-i - nuk-iv^ 1 r k - 2 )\ +Y E ( u k-iVk-i 1 ^- 2 ) 


k =1 


k=2 


k =2 


[ntj | ntj 

X] [C4_iU fe _i - E(f/ fc „ 1 U fc _ 1 1 J- fc _ 2 )] + A U k . 2 V k 


-2 


k=2 


k=2 


[ntj [n/.J 

0(n) + linear combination of E T4_2 and Vfc- 2 - 

fc =2 fc =2 


Consequently 

iMl 

Y u *-m 


L nt\ 


-Ufe-1 — 


k=2 


1-A 


[Ufe_il4_i — E([/fc_il4_i | IFk—2 


k=2 


[nt\ 


[nt\ 


— - --C/|_ nt j_iV[ nt j_i + 0(n) + linear combination of 'Y / Uk -2 and X} 14 


1-A 

Using (1A.8D with (. C,i,j ) = (4,1,1) we have 


- 2 - 


77, 5/2 SUp 
te[o,T] 


[nt\ 


X^ [^4-l^ifc-l — E(U fc _iU fc _i I Fk—2 


k=2 


k=2 k=2 


0 as n —> 00 . 


Thus, in order to show the statement, it suffices to prove 

(B.2) n~ 5/2 Vft-40, / 1~ 5/2 Y 1^1 °> n ' 5/2 SU P \ U lnt\V lnt] \ A 0 

fc =i k =1 i£ [°’ T ] 

as n —* 00 . Using (IA.6[) with = (2,1,0) and ( £,i,j ) = (2,0,1), and (lA.7j) with 

(£, i, j) — (3,1,1) we have (IB.21) . thus we conclude the statement. □ 


B.4 Lemma. Suppose that the assumptions of Theorem \3.1\ hold. If (V^theft, theft) = 0, then 
for each T > 0, 

L nt i 


n 1 sup 

te[o,T] 


E n 2 - Mt 


k= 1 


0 as n —>■ 00 , 
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where M is defined in Theorem \4.S\ 

Moreover, M = 0 if and only if (V^uieft, ^i e ft) + ('I’left ,m £ ) 2 = 0, which is equivalent to 
(1 - a)X K1 = for all keN. 


Proof. First we show 


(B-3) 


n 1 sup 
te[o,T] 


\nt\ 


k =1 


1- A 


0 


for each T > 0. Using recursion (1A.5D . we obtain 

| ^k— l) A14_ j T (uief-j, VTlfij, 


as n —>■ oo 


k e N. 


Thus 

\nt\ [nt\ n 

YVk = YlV k - E(f4 | Fk-i)] + A ^ Vfe-i + \ nt\ (rieft, m £ ). 

k= 1 k= 1 /c=l 

Consequently, 

\nt\ [nt\ . 

E U = — EK - E (U I -U-i)] - Vj + L"«J 

/c=l fc=l 


Using (lA.12j) with (£,j) 


(2,1) we obtain 


n 1 sup 


te[o,T] 


[nt\ 

Y [V k -E(V k \T f 


k -1 


fc=l 


as n —> oo. 


jp 

Using (1A.10I) with = (2,0,1) we obtain n~ l sup te r 0 T ] Vy n t\ | —> 0 as n —> oo, and 

hence we conclude (IB. 31) . 

In order to prove the convergence in the statement, we derive a decomposition of Yk=l V k 
as a sum of a martingale and some other terms. Using recursion ( 1A.5I) . we obtain 


E(I4 2 | J- k - 1) — E [(AI4-1 + (vi e ft, £ k )) | T k ~ i] 

= \ 2 Vl_ x + 2A(u left , m e )V k _ i + E((u left , e k ) 2 ). 


Thus 


[ nt J \nt\ |_ntj 

E v ? = E U 2 - E <u 2 i ^-0] + E ^ i ^ 

/c=l k= 1 


fc-lJ 


/c=l 


[ntj [nt\ 

E [u 2 - e(u 2 i -n-i)] + a 2 e u-i 


fc=i 


fc=i 


iMl 


2A(ui e ft, m e ) ^ ) Ufc —i T |_^tj E((ui e ft, S/fi 


k=\ 
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Consequently, 


\nt\ \nt\ 

E E W - i ^-o] 

k =1 fc=l 


A 2 

1-A 2 



2A(n left ,ra e ) 
+ 1-A 2 


\nt\ 

y Vfc-i+ 

^=1 


E((t; left ,£ fc ) 2 ) 
1-A 2 


Using (lA.12j) with (£,j) = (4,2) we obtain 


n 1 sup 
te[o,T] 


\nt\ 

E h? - e(u 2 i 

fe=i 


as n —> oo. 


Using (1A.10I) with = (3,0,2) we obtain n 1 sup tG [ 0jT ] Vj^i —» 0 as n —* oo. 

Consequently, by (1B.3p . we obtain 


n 1 sup 
te[o,T] 



k =1 


2A(n left , m £ ) 2 E((ni eft , £ fc ) 2 ) 

(1-A)(1-A 2 ) 1 — A 2 


= n 1 sup 
te[o,T] 


E V Z ~ Mt 


k= 1 



as n —)■ oo. 


Clearly M — 0 if and only if (V^theft, ^left) = 0 and (•ni e ft, m e ) = 0, which is equivalent 
to E((ni e f t , Si) 2 ) = (V^vieft, Vi e ft) + (ni c ft,m e ) 2 = 0 for all « 6 N, which is equivalent to 
(uieft, e k ) = (1— a)£k,i~f3£k,2 = 0 for all fceN, which is equivalent to (1 —a)X k ^—f3X k> 2 =’ 0 
for all fceN. □ 


B.5 Lemma. Suppose that the assumptions of Theorem \S.l\ hold. If (V^vieft, Uieft) = 0, then 
for each T > 0, 


n 


-2 


sup 

te[o,T\ 


\nt\ 

k=i 


(v leit: m £ ) 
1-A 


\nt\ 


E^-2 


k = 1 


as n —> oo. 


Proof. The aim of the following discussion is to decompose ^fc=i U k -iV k -i as a sum of a 
martingale and some other terms. Using the recursions (14.41) . (IA.5D . and Lemma [A. 11 we obtain 

E(Ufc_il 4 _i | Tk- 2) = E((Ufc _2 + ("Ui eft; A rnff ) (A V k — 2 T (rqeft? 1)) | -Fk— 2) 

= XU k _ 2 V k - 2 + (v lef t, m e )U k _2 + A('Uieft) m e )V k _2 
+ (uieft, m e )(uieft, m e ) + tijrf t E(Mjfc_iefc_ 1 1 
= \Uk- 2 Vk -2 + (theft, m e )C4_ 2 + constant + constant xl4_ 2 . 
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Thus 


\nt\ [nt] |n*l 

Y U k - iV fc -i = [^fe-1^-1 - E(C4 _iV*_i I ^- 2 )] + E(^-1^4-11 ^ 


fc-2; 


fe=l 


k=2 


k=2 


[nt\ [ntj 

X] [ 27 fc _iV^_i - E(C/ fc _ 1 y fc _ 1 1 T k .fi>] + A C/ fc _ 2 Vfc _2 

k=2 


\nt\ 


k=2 
[ntj 


+ ('Uleft 7 m £ ) Y U k -2 + 0(n) + constant x Y Vk- 2 - 

k=2 


k=2 


Consequently, 

\nt\ 

Y u k-i y k-i = 


[nt\ 


'Y, [Uk-iVk-i — E(f/fc_iVfc_i | J-fc- 2 )] — -— 


k=2 


1-A 


k =2 


left7 m e ) 

1-A 


[nt\ 


[ntj 


y] t/fc_ 2 + O(n) + constant x y k- 2 - 


k =2 


Using (lA.lip with (£,i,j) = (4,1,1) we have 

[ntj 

X] [Uk-iVk-i — E(Uk-iVk-i | T\ 


n 2 sup 
te[o,T] 


k -2 


k=2 


k=2 


0 as n-foo. 


Thus, in order to show the statement, it suffices to prove 

[nT\ 

(B.4) 


n 


-2 


Y \ V k\ ^0, n 2 sup I U \nt\ V[nt\ | 0 

te[o,T] 


k =1 


as n —* oo. Using (1A.9|) with (£,i,j) = (2,0,1), and (1A.10I) with ( £,i,j) = (3,1,1) we have 
(IB.4h . thus we conclude the statement. □ 

Now we can prove asymptotic existence and uniqueness of CLS estimators of the offspring 
mean matrix and of the criticality parameter in the critical case. 


B.6 Proposition. Suppose that the assumptions of Theorem I S. 1\ hold, and (V^ui e f t , ni e ft) + 
(Ue'ffieft, Uieft) + (theft, m e) 2 > 0- Then lim, woo P(f2 n ) = 1, where Vt n is defined in (j3. 2jl . 
and hence the probability of the existence of a unique CLS estimator fn^ converges to 1 as 
n —* oo. If (V^nieft, vieft) > 0 then Hindoo P(f2 n ) = 1, where Vl n is defined in (13. 5p . and 
hence the probability of the existence of the estimator g n converges to 1 as n —y oo. 


Proof. Recall convergence {n~ l U\n t \ )teR+ —> ((At)teM+ from (14. 6p . Using Lemmas IB. 21 IB .31 
1C.21 and 1C.31 one can show 


n 

n~ 3 Ul i 


id y 2 t dt 

£ 

n~ b / 2 U k -iV k -i 

v ^ 

0 

k =1 

1 

1 

e 


is ts hl si y«it 
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By (14. 12 j) and continuous mapping theorem, 

(B.5) n~ 5 det(A n ) ^ ^ left; left) f y 2 ^ f y tC y as n _s, qq. 

1 - A 2 y 0 Jo 

Since ra e 7 ^ 0, by the SDE (12. 8 p . we have P(37 = 0 for all t 6 [0,1]) = 0, which implies that 
Fifty? dt fo y *dt > 0) — 1- Consequently, the distribution function of /'( y 2 dt y t dt is 
continuous at 0 . 

If (V^Uieft, theft) > 0 then, by ( fB3|) . 

P(r2 n ) = P (det(A n ) > 0) = P ( n ~ 5 det(A n ) > 0) 

-> p ( >J left) jf' y 2 dt j^y t dt> o) = F^y?dt^y t dt>o s ) =1 

as n —> 00 . 


If (V^vieft, vieft) = 0, then, using convergence (14.61) and Lemmas IB.41 IB.511C.21 and 1C.31 
one can show 


n 

n ~ 3 u%_i 


fo yt dt 

E 

n~ 2 U k _ x V k ^ 

v ^ 

t’rr’fjy.dt 

fe=i 

1 

7 

e 


(v left ,m E ) 2 , (V£wieft,m e ) 
(1-A) 2 1 mP 


as n —> 00 . 


By (14.121) and continuous mapping theorem, 


n 4 det(A n ) 


v /(theft ,m £ ) 2 (V £ v leit ,m £ ) 


(1-A ) 2 

(V e VMt,m e ) f 1 

1 - A 2 Jn 


+ 


1-A 2 


yt d t - 


f'y,dt 2 


1-A 


, 21 , , («ie£t ,m e y 


y dt + 


(i-A y 


y? dt - 


'0 

r* 1 \ 2 N 

y t dt 


'0 


as n —y 00 . As above, P (/ 0 1 X 2 dt > 0) = 1. It is also known that P (/ 0 1 (V 2 dt — ( J 0 ' J7 dt)" > 
0) = 1, see, e.g., the proof of Theorem 3.2 in Barczy et al. [2]. Consequently, the distribution 
function of the above limit distribution is continuous at 0. Since (V^theft, theft) + (V e v i e ft, theft) + 
(theft,m £ ) 2 > 0 and (1^ theft, theft) = 0, we have (V £ v le{t , theft) > 0 or (v Mt ,m e ) 2 > 0, 
hence, 


P(h2 n ) = P (det(A„) > 0) = P (n 4 det(A n ) > 0) 
(Kr theft, m £ ) 


->• P 


1-A 2 


/'«•»* ttSf 


y 2 t ^ - 




1 


as n —> 00 . 

If (V$ theft, theft) > 0, then (13.61) yields rn^ m^ as n — * 00 , and hence rn^ — 

as n — 00 , thus (a? n — 5 n ) 2 + 4 / 5 n 7 n —(a — 5) 2 + 4/?7 = (1 — A ) 2 > 0, implying 


P(Q n ) = P((a„ - S n ) 2 + 4 /3 n % ^ 0) ->■ 1 as n —)• 00 , 
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hence we obtain the satement. 


□ 


Next we prove asymptotic existence and uniqueness of CLS estimators of the offspring mean 
matrix and of the criticality parameter in the subcritical case. 

B. 7 Proposition. Suppose that the assumptions of Theorem \3.8\ hold. Then lim^oo P(f2„) = 
1 and lim, woo P(f2 n ) = 1, where Vt n and Ll n are defined in (13. 2 J) and (I3.5H . respectively, 
and hence the probability of the existence of unique CLS estimators ffi^ and g n converges 
to 1 as n —» oo. 

Proof. Recall convergence 

as n —?• oo, 

from (17.21) . Consequently, 

n~ l det(A„) det jj, as n —» oo. 

The matrix E(XX ) is invertible, see the proof of Theorem 13.81 Thus det(E(XX )) > 0, 
and hence we obtain 

P(Q n ) = P(det(A n ) > 0) = P(n _1 det(A n ) > 0) —> 1, as n —)■ oo. 

The estimator in^ ,) is strongly consistent, hence rn"^ rri ^ as n —)• oo. Consequently, 
(a n - 6 n ) 2 + 0 n % (« - ^) 2 + 4/57 > 0, as n oo, 

and hence we obtain Hindoo P(f2 n ) = 1. □ 

C A version of the continuous mapping theorem 

The following version of continuous mapping theorem can be found for example in Kallenberg 
I.Q. Theorem 3.27]. 

C. l Lemma. Let ( S,ds ) and (T,dx) be metric spaces and (f n )ne n> £ be random elements 

with values in S such that f as n -E oo. Let f : S —> T and f n :S^T, n E N, be 

measurable mappings and C E B(S) such that P(£ E C) — 1 and liin ?woo dT(/n(sn), /(s)) = 0 
if lim ri ^ 00 d s (s n ,s) = 0 and sEC. Then /„(£„)—»/(£) as n -> oo. 

For the case S = D(M + ,M d ) and T = M3 (or T = D(M + ,M' ? )), where d, q E N, we 
formulate a consequence of Lemma 1C.11 

For functions / and f n , n E N, in D(K + ,M d ), we write f n -^4 / if (/ n )neN 
converges to / locally uniformly, i.e., if sup te [ 0 T ] ||/ n (i) — /(t)|| —* 0 as n —* oo for all 
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T > 0. For measurable mappings $ : D(M + ,M d ) —> M 9 (or : D(M + ,M d ) —y D(M + ,M 9 )) and 
<L n : D(M + ,M d ) —> M 9 (or : D(M + ,M d ) —> D(M + ,R 9 )), n G N, we will denote by C4($ n ) n6N 
the set of all functions / G C(R + ,R d ) such that $ n (/ n ) —> $(/) (or & n (fn) —■> $(/)) 
whenever f n -A / with f n G D(R + ,R d ), n G N. 

We will use the following version of the continuous mapping theorem several times, see, e.g., 
Barczy et ah [3J Lemma 4.2] and Ispany and Pap [TT1 Lemma 3.1]. 

C.2 Lemma. Let d,qEN, and and (wA)teR+; nGN, be R d -valued stochastic 

processes with cadlag paths such that IA^ U. Let $ : D(R + ,R d ) —> R 9 (or $ : 

D(R+, R d ) ->■ D(R + ,R 9 )j and <f>„ : D(R+, R d ) R 9 (or : D(R + , R d ) D(R + ,R 9 )j ; 
n G N, be measurable mappings such that there exists C C C4,($ n ) n6N with C G £>(D(R + ,R d )) 
and P (MgC) = 1. T/ten $ n (W (n) ) A $(W). 

In order to apply Lemma 1C.21 we will use the following statement several times, see Barczy 
et al. [51 Lemma B.3]. 

C. 3 Lemma. Let d,p,q gN, h : R d —* R 9 be a continuous function and K : [0, l]xl 2d —> R p 
be a function such that for all R > 0 there exists Cr > 0 such that 

(C.l) \\K(s,x) — K(t, y)\\ ^ C R (\t- s\ + ||x-j/||) 

for all s,t G [0,1] and x, y G R 2d with ||x|| ^ R and ||y|| ^ R. Moreover, let us define the 
mappings $, $ n : D(R + ,R d ) —» R 9+p , n G N, by 

1 " 

h(f(l)),-YK 

k=\ 

$(/) := (h(f{l)), K(u,f(u),f{u))duJ 

for all f G D(R + ,R d ). Then the mappings $ and Q n , n G N, are measurable, and 

Ct ,(*„)«„ = C(M + ,K d ) e B(D(K + ,K J )). 

D Convergence of random step processes 

We recall a result about convergence of random step processes towards a diffusion process, see 
Ispany and Pap m This result is used for the proof of convergence (15.IP 

D. l Theorem. Let -y : R + x W l —> R dxr be a continuous function. Assume that uniqueness 
in the sense of probability law holds for the SDE 




(D.l) 


dW t = 7 (*,W*)dW t , 


t G R 







with initial value Ho = u 0 for all u 0 6 R d , where (Wt)( 6 i + is an r-dimensional standard 
Wiener process. Let (U t)te k + be a solution of (ID.ID with initial value ZY 0 = 0 G R d . 

For each nGN, let (Gba be a sequence of d-dimensional martingale differences with 
respect to a filtration i.e v E(L/^ | J^j^) — 0, n G N, fcsN. Let 


\nt\ 

wS n) :=^C/i n) , teR + , ne N. 

fc=i 

Suppose that E (||L/*. n || 2 ) < oo for all n,k <E N. Suppose that for each T > 0, 


(i) sup 
te[o,T] 

V nT \ 


\nt\ 


E Var(C7«”> | 7 ( s . Wi"») 7 ( s , W<“>) T d s 


fc=l 


0 . 


(«) E Edit’ll 2 !,DS) ^+0 /oroii »>0, 


fc=l 


where 



denotes convergence in probability. 


Then 


U {n) 



as n —> oo. 


Note that in (i) of Theorem ID.II || • || denotes a matrix norm, while in (ii) it denotes a 
vector norm. 
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